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Abstract — We analyze fading interference relay networks 
where AI single-antenna source-destination terminal pairs 
communicate concurrently and in the same frequency band 
through a set of K single-antenna relays using half-duplex 
two-hop relaying. Assuming that the relays have channel 
state information (CSI), it is shown that in the large-A/ limit, 
provided K grows fast enough as a function of M, the network 
"decouples" in the sense that the individual source-destination 
terminal pair capacities are strictly positive. The corresponding 
required rate of growth of K as a function of M is found to be 
sufficient to also make the individual source-destination fading 
links converge to nonfading links. We say that the network 
"crystallizes" as it breaks up into a set of effectively isolated 
"wires in the air". A large-deviations analysis is performed to 
characterize the "crystallization" rate, i.e., the rate (as a function 
of M, K) at which the decoupled links converge to nonfading 
links. In the course of this analysis, we develop a new technique 
for characterizing the large-deviations behavior of certain sums 
of dependent random variables. For the case of no CSI at the 
relay level, assuming amplify-and-forward relaying, we compute 
the per source-destination terminal pair capacity for M, K oo, 
with K/AI p fixed, using tools from large random matrix 
theory. 

Index Terms — Amplify-and-forward, capacity scaling, crystal- 
lization, distributed orthogonalization, interference relay network, 
large-deviations theory, large random matrices, large wireless net- 
works. 

I. Introduction 

THE CAPACITY of the relay channel [3], [4] is still un- 
known in the general case. Recently, the problem has at- 
tracted significant attention, with progress being made on several 
aspects [5]. Sparked by [6], [7], analysis of the capacity' scaling 
behavior of large wireless (relay) networks has emerged as an 
interesting tool [8]-[14], [2], [1], which often allows to make 
stronger statements than a finite-number-of-nodes analysis. In 
parallel, the design of distributed space-time codes [15]-[17], the 
area of network coding [18], [19], and the understanding of the 
impact of relaying protocols and multiple-antenna terminals on 
network capacity [17], [20], [21] have seen remarkable activity. 

This paper deals with interference fading relay networks where 
AI single- antenna source-destination terminal pairs communi- 
cate concurrently and in the same frequency band through half- 
duplex two-hop relaying over a common set of K single-antenna 
relay terminals (see Fig. 1). Two setups are considered, i) the 
coherent case, where the relays have channel state information 
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induced by the considered protocols, not the capacity of the network itself. 




Fig. 1. Dense wireless interference relay network with dead-zones around 
source and destination terminals. Each terminal employs one antenna. 

(CSI), perform matched-filtering, and the destination terminals 
cannot cooperate, and ii) the noncoherent case, where the relays 
do not have CSI, perform amplify-and-forward (AF) relaying, 
and the destination terminals can cooperate. In the coherent case, 
the network operates in a completely distributed fashion, i.e., 
with no cooperation between any of the terminals whereas in the 
noncoherent case the destination terminals can cooperate and 
perform joint decoding. 

A. Contributions and Relation to Previous Work 

Our main contributions for the coherent case can be summa- 
rized as follows: 

• We consider two different protocols, PI introduced (for the 
finite-A/ case) in [1] and P2 introduced in [2]. PI relies on 
the idea of relay partitioning (i.e., each relay is assigned 
to one source-destination terminal pair) and requires each 
relay terminal to know its assigned backward (source to 
relay) and forward (relay to destination) channel only. The 
relays perform matched-filtering with respect to (w.r.t.) their 
assigned backward and forward channels. P2 does not use 
relay partitioning, requires each relay terminal to know all 
M backward and all M forward channels, and performs 
matched-filtering w.r.t. all M backward and M forward 
links. 

Previous work for the coherent case has established the 
power efficiency scaling of P2 for AI — > oo with K — 
Ad^ [2]; in [1] it was shown that for PI with AI fixed, 
in the K ^ oo limit, network capacity scales as C = 
{M/2)log{K) + 0(1). The results in [1] and the coiTe- 
sponding proof techniques, however, rely heavily on M 
being fixed when K ^ oo. When M, K ^ oo, the 
amount of interference (at each destination terminal) grows 
with M. Establishing the corresponding network capacity 
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scaling behavior, tiierefore, requires fundamentally new 
techniques, which are developed in this paper. In particular, 
we derive the network (ergodic) capacity scaling behavior 
for M, K oc for PI and P2 by computing a lower and 
an upper bound on the per source-destination terminal pair 
capacity, and by showing that the bounds exhibit the same 
scaling (in M, K) behavior. The technique used to establish 
the lower bound is based on a result found in a completely 
different context in [22] and applied in [2] to derive the 
power efficiency scaling of P2. For our purposes, we need a 
shght generahzation of the result in [22], which follows, in 
a straightforward fashion, from a result on nearest-neighbor 
decoding reported in [23]. For the sake of completeness, 
we state, in Appendix E, the relevant inequaUty in the form 
needed in the context of this paper. The matching upper 
bound on the per source-destination terminal pair capacity 
poses significantly more technical challenges and is based 
on a large-deviations analysis of the individual link SINR 
(signal to interference plus noise ratio) random variables 
(RVs). In summary, we prove that in the large-M limit, pro- 
vided the number of relay terminals K grows fast enough 
as a function of Af, under both protocols PI and P2 the 
network "decouples" in the sense that the individual source- 
destination terminal pair (ergodic) capacities are strictly 
positive. The corresponding minimum rates of growth are 
if oc for PI and K (X for P2, with the per source- 
destination terminal pair capacity scaling (for M,K ^ oo) 
given by Cpi = (1/2) log (l + 6 (if/M^)) and Cp2 = 
(1/2) log(l + e{K/M^)), respectively. The protocols PI 
and P2 thus trade off CSI at the relays for the required 
(for the network to decouple) rate of growth of the number 
of relays. We hasten to add that an ergodic-capacity lower 
bound for P2 was previously established in [2] ; this bound is 
restated (and reproved under slightly different assumptions) 
in this paper for the sake of completeness. It appears, 
however, that [2] does not establish the minimum rate of 
growth of the number of relays for the network to decouple. 
• We analyze the network outage capacity behavior induced 
by PI and P2 using a large-deviations approach. More 
specifically, we show that the growth rates K cx in 
PI and K oc in P2 are sufficient to not only make 
the network decouple, but also to make to the individual 
source-destination fading links converge to nonfading links. 
We say that the network "crystallizes" as it breaks up into 
a set of effectively isolated "wires in the air". Each of the 
decoupled links experiences distributed spatial diversity 
(or relay diversity), with the corresponding diversity order 
going to infinity as M ^ oo. Consequently, in the large-M 
limit, time diversity (achieved by coding over a sufficiently 
long time horizon) is not needed to achieve ergodic capacity. 
We obtain bounds on the outage capacity of the individual 
source-destination links, which allow to characterize the 
"crystallization" rate (more precisely a guaranteed "crys- 
tallization" rate as we do not know whether our bounds 
are tight), i.e., the rate (as a function of M, K) at which 
the decoupled links converge to nonfading links. In the 
cotffse of this analysis, we develop a new technique for 



characterizing the large-deviations behavior of certain sums 
of dependent RVs. This technique builds on the well-known 
truncation approach and is reported in Appendix A. 

• For PI and P2, we establish the impact of cooperation at 
the relay level on network (ergodic) capacity scaling. More 
specifically, it is shown that, asymptotically in M and K, 
cooperation (realized by vector matched filtering) in groups 
of L relays leads to an L-fold reduction in the total number 
of relays needed to achieve a given per source-destination 
terminal pair capacity. 

Previous work for the noncoherent ( AF) case [ 1 ] demonstrated 
that for M fixed and K oo, AF relaying turns the fading 
interference relay network into a fading point-to-point multiple- 
input multiple-output (MIMO) link, showing that the use of 
relays as active scatterers can recover spatial multiplexing gain 
in poor scattering environments. Oiu" main contributions for the 
noncoherent (AF) case are as follows: 

• Like in the coherent case, the proof techniques for the 
noncoherent (AF) case in [I] rely heavily on M being 
finite. Building on results reported in [24], we compute 
the M,K ^ oo (with K/M — » /3 fixed) per source- 
destination terminal pair capacity using tools from large- 
random-matrix theory [25], [26]. The limiting eigenvalue 
density function of the effective MIMO channel matrix 
between the source and destination terminals is charac- 
terized in terms of its Stieltjes transform as the unique 
solution of a fixed-point equation, which can be transformed 
into a fourth-order equation. Upon solving this fourth- 
order equation and applying the inverse Stieltjes transform, 
the remaining steps to computing the limiting eigenvalue 
density function, and based on that the asymptotic network 
capacity, need to be carried out numerically. We show that 
this can be accomplished in a straightforward fashion and 
provide a corresponding algorithm. 

• We show that for /3 ^ oo, the fading AF relay network is 
turned into a fading point-to-point MIMO Hnk (in a sense to 
be made precise in Section V), thus establishing the large- 
M, K analog of the result found previously for the finite-M 
and K ^ oo case in [I]. 



The superscripts ^, ^ , and * stand for transposition, conjugate 
transpose, and element- wise conjugation, respectively. \X\is 
the cardinality of the set X. log(x) stands for the logarithm 
to the base 2, and ln(a;) is the natural logarithm. I[x\ = 1 if 
X is true and I[x\ = if a; is false. 5[k] = 1 for /c = 
and otherwise. The unit step function u{x) = for a; < 
and u{x) = 1 for a; > 0. E and Var denote the expec- 
tation and variance operator, respectively, [a;] stands for the 
smallest integer greater than or equal to x. arg(a;) stands for 
the argument of a: S C. A circularly symmetric zero-mean 
complex Gaussian RV is a RV Z = X + j F ~ CA/'(0, a^), 
where X and Y are independent identically distributed (i.i.d.) 
A/'(0, (7^/2). An exponentially distributed RV with parame- 
ter A is a real-valued RV X with probability density func- 
tion (pdf) given by fx{x) = Xex.p{—Xx)u{x). A Rayleigh- 
distributed RV with parameter is a real- valued RV X with 



B. Notation 
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pdf fx{x) — {x/a'^)exp(^—x'^/{2a'^))u{x).U{a,b) denotes 
the uniform distribution over the interval [a, b]. S{x) is the Dirac 
delta distribution. The moment-generating function (MGF) of 
a RV X is defined as Mx{s) = e'''fx{x)dx. {x)+ = x 
for a; > and otherwise. For two functions /(x) and g{x), 
the notation f{x) = 0{g{x)) means that \ f{x) /g{x)\ remains 
bounded as a; — > oo. We write 17(2;) = Q{f{x)) to denote 
that f{x) — 0{g{x)) and g{x) — 0{f{x)). For two func- 
tions f{x) and g{x), the notation f{x) — o{g{x)) means that 
|/(a;)/.g(a;)| as x — > cx3. Matrices and vectors (both deter- 
ministic and random) are denoted by uppercase and lowercase, 
respectively, boldface letters. The element of a matrix X in the 
nth row and mth column and the nth element of a vector x are 
denoted as [X]„ ,„ and [x]„, respectively. Ai(X), A,nin(X), and 
Aniax(X) Stand for the ith, the minimum, and the maximum 
eigenvalue of a matrix X, respectively. X o Y is the Hadamard 
(or element-wise) product of the matrices X and Y. ||x|| denotes 
the i^-norm of the vector x. SRz and 3z designate the real and 
imaginary part of z G C, respectively. C+ = {z E C\^z > 0}. 
For any n, to G N, to > n, [n : m] denotes the natural numbers 
{n, n + 1, . . . , to}. 



C. Organization of the Paper 

The rest of this paper is organized as follows. Section II 
describes the general channel model and the parts of the signal 
model^ that pertain to both the coherent and the noncoherent 
case. Sections III and IV focus on the coherent case exclusively: 
Section III contains the large-deviations analysis of the indi- 
vidual link SINRs for PI and P2. In Section IV, we present 
our ergodic -capacity scaling results, discuss the "crystallization" 
phenomenon, and study the impact of cooperation at the relay 
level. In Section V, we present our results on the asymptotic 
network capacity for the noncoherent (AF) case. We conclude in 
Section VI. The new technique to establish the large-deviations 
behavior of certain sums of dependent RVs is presented in 
Appendix A. Appendix B summarizes a set of (union) bounds 
used heavily throughout the paper. Appendices C and D contain 
the proofs of Theorems 1 and 6, respectively. The result from [23] 
needed for the proof of the ergodic capacity lower bounds for PI 
and P2 is summarized in Appendix E. Appendix F contains some 
essentials from large-random-matrix theory needed in Section V. 
In Appendix G, we detail part of the solution of the fixed-point 
equation underlying the main result in Section V. 



II. Channel and Signal Model 

In this section, we present the channel and signal model and 
additional basic assumptions. We restrict ourselves to the aspects 
that apply to both coherent and noncoherent networks and to both 
protocols considered in the coherent case. Relevant specifics for 
the coherent case will be provided in Sections III-A and III-B 
and for the noncoherent case in Section V. 



-The motivation for the channel model considered in this paper can be found 
in[l]. 
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Fig. 2. Two-hop wireless relay network setup. 

A. General Assumptions 

We consider an interference relay network (see Figs. 1 and 2) 
consisting of i^T + 2M single-antenna terminals with M desig- 
nated source-destination terminal pairs {Sm , 2?„j } (to G [1 : M] ) 
and K relays TZk {k £ [1 liC]). We assume a "dead-zone" of 
non-zero radius, free of relays, around each of the source and 
destination terminals, no direct link between the individual 
source-destination terminal pairs (e.g., due to large separation), 
and a domain of fixed area (i.e., dense network assumption). 
Transmission takes place in half-duplex fashion (the terminals 
cannot transmit and receive simultaneously) in two hops (a.k.a. 
two-hop relaying) over two disjoint time slots. In the first time 
slot, the source terminals simultaneously broadcast their informa- 
tion to all the relay terminals (i.e., each relay terminal receives a 
superposition of all source signals). After processing the received 
signals, the relay terminals simultaneously broadcast the pro- 
cessed data to all the destination terminals during the second time 
slot. Our setup can be considered as an interference channel [27] 
with dedicated relays, hence the terminology interference relay 
network. 

B. Channel and Signal Model 

Throughout the paper, frequency-flat fading over the band- 
width of interest as well as perfectly synchronized transmission 
and reception between the terminals is assumed. For the finite- A/ 
and K 00 case it has been shown in [28] that the perfect- 
synchronization assumption can be relaxed, under quite general 
conditions on the synchronization errors, without impact on the 
capacity scaling laws. The input-output (I-O) relation for the 
link between the source terminals and the relay terminals during 
the first time slot is given by 

r=(EoH)s + z (1) 

where r = [ri , 7-2, . . . , rnY' with denoting the signal received 
at the fcth relay terminal, E e M.^^" with [E]fc_m = \/Ek,m 
where i?fc,„i denotes the average energy received at 7?,fc through 
the Sm ^ Tlk link-' (having accounted for path loss and shadow- 
ing in the Sm TZk link), H e C^><^^ with [H]fe, ,„ = hk,„, 
(fc e [1 : K], TO e [1 : M]) where hk,m ^ CAf{0, 1) denotes 
the i.i.d. complex-valued channel gains corresponding to the 

■^A. — > B signifies communication from terminal A to terminal B. 
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Sm T^k links, s = [si, S2, . . . , sm]^ where Sm is the zero- 
mean Gaussian signal transmitted by Sm and the vector s is 
i.i.d. temporally and spatially (across source terminals). Finally, 
z = [zi, Z2, ■ ■ ■ , where zj. ^ CA/'(0, cr^) is temporally 
and spatially (across relay terminals) white noise. The /cth relay 
terminal processes its received signal to produce the output 
signal tk- The collection of output signals tk, organized in the 
vector t = [fi, • • • , i/f]^. is then broadcast to the destination 
terminals during the second time slot, while the source terminals 
are silent. The mth destination terminal receives the signal ym 
withy = [yi,y2,- 



■,2/m] given by 
y = (PoF)t- 
^^x^ with fPl„,_, = 



w 



(2) 



where P € W'^^'^'^ with \P]m,k = \/Pm,k and P^.k denotes 
the average energy received at Vm through the TZk T>m link 
(having accounted for path loss and shadowing in the TZk 'Dm 
link). Furthermore, F G C^xk ^jjj^ [Y]m,k = /m,fe (m € [1: 
M], fc G [1 : K]) where fm,k ~ CA/'(0, 1) denotes the i.i.d. 
complex-valued channel gains corresponding to the TZk 
links, and w = [wi, u;2, uim]^ with w„ ~ CA/'(0,cr^) 
being temporally and spatially (across destination terminals) 
white noise. Throughout the paper, we impose a per-source- 
terminal power constraint E[|sm|^] < 1/M (m G [1 : M]), 
which results in the total transmit power trivially satisfying 
]E[1|s||^] < 1. Furthermore, we impose a per-relay-terminal 
power constraint E[|t;jp] < Pre\/K{k G [1 : /sT]), which results 
in the total power transmitted by the relay terminals satisfying 
]E[|lt||^] < Pioi. As already mentioned above, path loss and 
shadowing are accounted for through the Ek,m {k G [1 : K], 
m G [1 : M]) (for the first hop) and the Pm,k (m G [1 : M], 
k G [1 : -RT]) (for the second hop). We assume that these 
parameters are deterministic, uniformly bounded from above 
(follows from the dead-zone assmnption) and below (follows 
from considering a domain of fixed area) so that for all fc, m 

0<E< Ek,m <E<oo 0<P< Pm,k <P<oo. (3) 

Throughout the paper, we assume that the source terminals Sm 
(m G [1 : M]) do not have CSI. The assumptions on CSI at 
the relays and the destination terminals depend on the setup 
(coherent or noncoherent case) and the protocol (in the coherent 
case) and will be made specific when needed. 

A discussion of the motivation for the two scenarios analyzed 
in this paper can be found in [1]. 

III. The Coherent Case 

In this section, we describe the two protocols PI and P2 and 
derive the corresponding SINR concentration results along with 
the resulting bounds on the individual source-destination link 
outage probabihty induced by PI and P2. Note that the results 
in this section do not require ergodicity of H and F. 

A. Protocol 1 (PI) 

The basic setup was introduced in Section II. We shall next 
describe the specifics of P 1 . The K relay terminals are partitioned 
into M subsets Mm {me [1 : M]) with"* \Mm\ = K/M. The 

''For simplicity, we assume that X is an integer multiple of M. Moreover, in 
the remainder of the paper all results pertaining to PI impUcitly assume K > M. 



relays in Aim are assumed to assist the mth source-destination 
terminal pair {Sm , Dm } ■ This assignment is succinctly described 
through the relay partitioning function p : [1,K] [Ij-^] 
defined as 

p{k) 4 m<^7^fc e Mm- 

We assvune that the fcth relay terminal has perfect knowledge 
of the phases Sirg{hk^p(k)) and &'i:g{fp(k),k) of the single-input 
single-output (SISO) backward (from the perspective of the re- 
lay) channel Spf^k) ~^ T^k and the corresponding forward channel 
TZk Dpi^k)^ respectively. We furthermore define hk,p{k) — 
exp(jarg(/ife^p(fe))) and fp(^k),k = exp(jarg(/p(fc)^fc)). The 
signal Tfe received at the fcth relay terminal is first cophased 
w.r.t. the assigned backward channel followed by an energy 
normalization so that 



Uk = dpi^k K,p{k) '^k 



where 



K 
M 



M 



Ek,m + Ka"^ 



-1/2 



(4) 



(5) 



ensures that the per-relay power constraint E [ | Ufc | ^] = Prei / K 
is met. The relay terminal TZk then computes the transmit signal 
tk by cophasing w.r.t. its assigned forward channel, i.e.. 



*fc — /p(fe),/c 



(6) 



which, obviously, satisfies E [ | f fe < Prei /K with equality and 
hence meets the total power constraint (across relays) E [ 1 1 1 1 1 ^] = 
X^i^i = -Prei- In svunmary, PI ensures that the relays 

TZk G Mm forward the signal intended for namely, the 
signal transmitted by Sm, in a "doubly coherent" (w.r.t. backward 
and forward channels) fashion, whereas the signals transmitted 
by the source terminals Sm with rh m are forwarded to 
T>m in a "noncoherent" fashion (i.e., phase incoherence occurs 
either on the backward or the forward link or on both links). The 
idea underlying PI has originally been introduced in [1] (for the 
finite-M case). 

We shall next derive the I-O relation for the SISO channels 
Sm T)m (™ G [1 : M]). The destination terminal T>m receives 
doubly (backward and forward link) coherently combined con- 
tributions corresponding to the signal Sm, with interfering terms 
containing contributions from the signals Sm with m 7^ m as 
well as noise, forwarded by the relays. Combining (1), (4), (6), 
and (2), it follows (after some straightforward algebra) that the 
signal received at Vm {me [1 : M]) is given by^ 



1 



K 

Em,m 

fe=i 



rh^m 



effective channel gain 

1 ^ - 



fe=i 



1 ^ 

+ ^Y.^k^k + Wm (7) 
fe=l 

✓ ~- ' 



interference noise 

'The notation , , stands for the summation over tti 6 [1 : Afl s.t. 
m m.Jf not specified, the upper limit of the summation is clear from the 
context. 
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sinrpi 



K 

fe=l 



K 

Km^m k=l 



K 

E 

fe=i 



KMa^ 



(15) 



where 



t ~ '-^Pl.fe Jp{k),k Jrn,k "-fc,p(fe) 
"fe — ^Pl,fc Jp(k),k Jm,k il'k,p{k) 



with 



Pi.fc 



(8) 
(9) 



(10) 
(11) 



The nomaUzation factor in (7), (10), and (1 1) is introduced 
for convenience of exposition. Using (3), it now follows that 



C = il^ < Gp, ^ 



^.lEJ^Ac (12) 



PPr 



c = \ =- 



rcl 



pi,fc 



< 



E + a"^ 

' PPrel A g 



(13) 



for all fee [1 : i^], m e [1 : M], and m e [1 : M]^In the 
following, it will be essential that the constants C, c, C, and c 
do not depend on M, K. 

Since we assumed that the destination terminals r>„ 
(m G [1 : Af]) cannot cooperate, the Dm cannot perform joint 
decoding so that the network can be viewed as a collection of M 
SISO channels Sm 2^m. i-c, as an interference channel with 
dedicated relays. We can see from (7) that each of these SISO 
channels consists of a fading effective channel, fading interfer- 
ence, caused by the source signals not intended for a given des- 
tination terminal, and finally a noise term incorporating thermal 
noise forwarded by the relays and thermal noise added at the des- 
tination terminals. In the remainder of this section, we make the 
conceptual assumption that each of the destination terminals 
has perfect knowledge of the fading and path loss and shadow- 
ing coefficients in the entire network, i.e., T>m {m G [1:M]) 
knows H, F, E and P perfectly. An immediate consequence of 
this assumption is that 2?^ {m £ [1:M]) has perfect knowledge 
of the effective channel gain (1 / \/K) j^^i a™'™, the interfer- 
ence channel gains '^fe* '" ("^ "^)' ^'l '^1'^ 
quantity {1/VK) J2k=i Conditioned on H and F, both the 
interference and the noise term in (7) are Gaussian, so that the 
mutual information for the Sm — * T^m link is given by 



|H,F) = ^log(l + SINRPi) 



(14) 



where SINRJ^^^, defined in (15) at the top of the page, is the 
effective SINR in the SISO channel Sm ^ T>m. 

We conclude by noting that the large-deviations results in Sec- 
tion III-C rely heavily on the assumption that 2?„, (m G [1 : M]) 
knows H, F, E, and P perfectly. The ergodic capacity-scaUng re- 
sults in Section IV wUl, however, be seen to require significantly 
less channel knowledge at the destination terminals. 



B. Protocol 2 (P2) 

The only difference between PI and P2 is in the processing at 
the relays. Whereas in PI the K relay terminals are partitioned 
into M clusters (of equal size) with each of these clusters assist- 
ing one particular source-destination terminal pair, in P2 each 
relay assists all source-destination terminal pairs so that relay 
partitioning is not needed. In turn, P2 requires that each relay 
knows the phases of all its M backward and M forward channels, 
i.e., TZk needs knowledge of hk,m and fm,k, respectively, for 
me [1 : M] . Consequently, P2 requires significantly more CSI 
at the relays than PI . The relay processing stage in P2 computes 



M 



tk = dp2,k Yl ~^tm fm,k rk 



(16) 



where 



P2,fe 



M 



-1-1/2 



K E 



m—l 



ensures that the power constraint E[|ffep] = P^ei/K and 
henceE[||tf] = Ef=i E[|tfcp] = P,ei is met. 

Again, we start by deriving the l-O relation for the SISO 
channels iS^ Vm {m £ [1 : M]). Like in PI, the destination 
terminal Vm receives doubly (backward and forward link) co- 
herently combined contributions corresponding to the signal 
Sm, interfering terms containing contributions from the signals 
Srh with m ^ m, as well as noise forwarded by the relays. 
Combining (1), (16), and (2), it follows that the signal received 
at T>m (to G [1 : Af ]) is given by 

K M 

^ \ ^ \ ^ m,m,m 



effective channel gain 



K M 



m^m k—1 m=l 



interference 

K M 



+ 



K=l m=l 



where 



with 



""k ~ ^P2,fc /m,fc Jm,k l^kMi 'l'k,m 

,m,rh A /^m 7* f , h* 
"k ~ ^P2,k Jm,k Jm,k i'-k,fh. 



^P2','fc ~ V KMdp2,k\/Pm,kEk,m 
C^2,k = VKMdp2,kVPn^. 



(18) 

(19) 
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K M 

|EE- 

k=l m=l 



/ KM 

E|EE' 

Krhjtm fe=l 7n=l 



if 



M 

E^ 

fc=l m=l 



^2 



(21) 



Again, the normalization ^/KM in (17), (18) and (19) is intro- 
duced for convenience of exposition and 



for all fee [1 : JT], m G [1 : M], and m G [1 : M] with the 
constants C, c, C, and c not depending on M, 

Recalling that we assume perfect knowledge of H, F,E, 
and P at each of the destination terminals, 2?„j, the mutual 
information for the Sm T^m link in P2 is given by 

s„ I H, F) = i log(l + SINR^^) (20) 

where SINR^^j^, defined in (21) at the top of the page, is the 
effective SINR in the SISO channel Sm 'Dm- 

C. Large-Deviations Analysis of SINR 

Our goal in this section is to prove that SINR^^ and SINR^^ 
for m G [1 : M] (and, thus, the corresponding mutual information 
quantities (14) and (20)) lie within "narrow intervals" around 
their mean values with^ "high probability" when M,K oo. 
The technique we use to prove these concentration results is 
based on a large-deviations analysis and can be summarized as 
follows: 

i) Consider each sum in the numerator and denominator 
of (15) and (21) separately. 

ii) Represent the considered sum as a sum of independent 
RVs or as a sum of dependent complex- valued RVs with 
independent phases. 

iii) Find the mean value of the considered sum. 

iv) Employ a large-deviations analysis to prove that the con- 
sidered sum hes within a narrow interval around its mean 
with high probability, i.e., establish a concentration result. 

v) Combine the concentration results for the separate sums 
using the union bounds summarized in Appendix B to 
obtain concentration results for SINR^^ and SINRJ^^. 

1) Chernojf bounds: Before embarking on a detailed discus- 
sion of the individual Steps i-v above, we note that a well-known 
technique to establish large-deviations results for sums of RVs 
(as required in Step iv above) is based on Chernoff bounds. This 
method, which yields the precise exponential behavior for the 
tails of the distributions under question, can, unfortunately, not be 
applied to all the sums in (15) and (21). To solve this problem, 
we develop a new technique, which allows to estabhsh large- 
deviations results for certain sums of dependent complex-valued 
RVs with independent phases where the RVs occurring in the 
sum are s.t. their MGF does not need to be known. The new 
technique is based on the well-known idea of truncation of RVs 
and will, therefore, be called truncation technique. Even though 
truncation of RVs is a standard concept in probability theory, and 
in particular in large-deviations analysis, we could not find the 

*The precise meaning of "narrow intervals" and "high probability " is explained 
in the formulation of Theorems 1 and 2 in Section ni-D. 



specific approach developed in this paper in the literature. We 
therefore decided to present the truncation technique as a stand- 
alone concept and summarized the main results in Appendix A. 
Before proceeding, we note that even though the truncation 
technique has wider apphcabihty than Chernoff bounds, it yields 
weaker exponents for the tails of the distributions under question. 

Although the proofs of the main concentration results. Theo- 
rems 1 and 2 in Section III-D, are entirely based on the truncation 
technique, we still discuss the results of the application of 
Chernoff bounds (without giving all the details) in the following, 
restricting our attention to PI, to motivate the development of the 
truncation technique and to provide a reference for the quality 
(in terms of tightness of the bounds) of the results in Theorems 1 
and 2. Moreover, the developments below introduce some of the 
key elements of the proofs of Theorems 1 and 2. 

Following the approach outlined in Steps i-v above, we start 
by writing SINR^^ as 

PI |5(1)+5(2)|2 



SINR: 



(22) 



■ 5(3) + ct2MS'(4) + KMa"^ 
and establishing bounds on the probabiUty of large deviations of 



^(1) A ^ Cp{^\fm,k\\hk,m\ 
k:p{k)=m 

5'(2) A ^ Cp{^ fp(k),k fm,k ^''k,p{k) ^k,m 
k:p{k)^m 
K 

g{3) A ^ C'pi'.T fv(k),k fm,k ^fc.p(fc) hk,r, 

rh^m fc=l 

Si.) A _^)2 



(23) 
(24) 

(25) 

(26) 



k=l 



We shall see in the following that the pdfs of the terms 
in 5*'^^ S^'^\ and S*'^' have a structure that is simple enough for 
Chernoff bounds to be applicable. We start with the analysis of 
the simplest term, namely S^^'' . To avoid unnecessary technical 
details and to simplify the exposition, we assume (only in the 
ensuing analysis of the large deviations behavior of S*^^)) that 



a 



pi.fe 



Pl,fe 



(27) 



for all m, m e [1 : M], A; e [1 : K]. Defining^ Xk = 
we have 



K 



k=\ 



where the Xk are i.i.d. exponentially distributed with parame- 
ter A = 1, i.e., fxki^) — exp(— x) u{x) and hence E[Xi,] = 1. 
For convenience, we centralize X^ and define Zk = Xk — 1. 
The MGF of Zk is given by 



''dx = 



SRs < 1. (28) 



'For notational convenience, we shall omit the index m in what follows. 
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Since the RVs are independent, we obtain, using the standard 
Chemoff bound (see, for example, [29, Section 5.4]), for a; > 



K 



< min (Mx,(s))^e 



0<s<l 



mm e 

0<s<l 



-Ks-K\n{\-s)- 



(29) 



Because {Mzt, (s))^ exp(— sa;) is convex in s [29, Section 5.4], 
the minimum in (29) can easily be seen to be taken on for s = 
x/{x + K), which gives 



ln(K)-x 



(30) 



The corresponding relation for negative deviations {x < 0) is 



K 



^Zk<x \ < 



.fe=i 



lnix+K)-K ln{K)-x ^ ^ > 

0, X < -K. 



(31) 



Finally, setting a; = V Kt, we get the desired concentration 
result for the sum 5(4) 

as 

p|5(4) _K> s/Kt] < e^in(i+*/v^)-v^*, t > (32) 



)>|5(4) _K< ^/Kt] 



< 



0, t < -^JK. 



(33) 



We now consider the case when K is large and t = o(v^) so 
that 



(34) 



If we omit higher (than second) order terms in (34), the bound 
in (32) and (33) can be compactly written as 




{|s(4)-i^|>V^i}<2e-*'/2. 



(35) 



We can, therefore, conclude that the probability of large devia- 
tions of 5(4) decays exponentially. 

Similar concentration results, using Chemoff bounds, can 
be established for S''^^ and S''^^'. The derivation is somewhat 
involved (as it requires establishing upper bounds on the MGF), 
does not provide insights into the problem and will, therefore, 
be omitted. Unfortunately, the simple technique used above to 
establish concentration results for 5^4) (and applicable to 5^^^ 
and 5^^^) does not seem to be applicable to S'^^\ To see this, we 
start by noting that S''^^ contains two classes of terms (in the 
sense of the properties of their pdf), i.e.. 



5(3) ^ ^(31) _^ ^(32) 



with 



(36) 



(37) 



5(32) ^ ^ ^ ^ C'^i,™ /p(fe),fe /m.fe ^*k,p{k) ^ 
rhjtm k=l k^k 



k.rh 



^ C™'J f^ f^ h,p{k) K,m ^^^^ 

Now, there are two problems in applying the technique we have 
used so far to S'^^^: First, it seems very difficult to compute the 
MGFs for the individual terms in S^^^' and 5^^^' ; second, the 
individual terms in S'^^^^ and S'^'^^^ are not jointly^ independent 
across the summation indices. The first problem can probably 
be resolved using bounds on the exact MGFs (as can be done 
in the analysis of S^^^ and S**^^^). The second problem, however, 
seems more fimdamental. In particular, the individual terms 
in S^^^^ are independent across k but not across m. In S^^'^\ the 
individual terms are independent across k but not across k and m. 
Assuming that the problem of computing (or properly bounding) 
the MGFs is resolved, a natural way to overcome the second 
problem mentioned above would be to establish concentration 
results for the sums over k, i.e., for 



C=E(^Pi,t) \fm,k\'\hk,^\' (39) 
fe=i 

K 

A(32) A_ \ ^ ^m,rh 7* f J,* i, 
m,k ~ ^Pl,k Jp{k),k Jm,k 'i'k,p{k) "fc,™ 



fe=l 



^ Cp '™ f*^j_ H,p{k) K,rh 



and to employ the union bound for sums (Lemmas 2 and 4 
in Appendix B) to obtain concentration results for S'^^'^^ and 
5*^^^^ Unfortunately, this method, although applicable, yields 
results that are very loose in the sense of not reflecting the 
correct "order-of-magnitude behavior" of the typical deviations. 
To understand why this is the case, we perform an order-of- 
magnitude analysis as follows. For simphcity, we again assume 
that the condition (27) is satisfied. Note that for any k,k € [^-K] 
s.t. k k and any me [1 : M] s.t. m,we have 



E 



fp{k),kfm,k K,p{k) ^k,rh fp{k),k fm,k ^k,p{k) 



= 0. 



Chemoff boimding S^^'^~ would, therefore, yield that 



L I TTlyk J 



decays exponentially' in t. Then, applying the union bound for 
sums (Lemma 
conclude that 



sums (Lemma 2) to ^(32) = ^^^^ J^k^^ S^^t ^""l'^ 



{|S'(32) >{M-l){K-l)VKt} 



(41) 



rh^m k=l 



decays exponentially in t. Even though the terms in S'^"^^) ^re 
not completely independent across k and m, we will see in 

*We write "jointly independent", as opposed to "pairwise independent" here 
and in what follows to stress the fact that the joint pdf of the RVs under 
consideration can be factored into a product of the marginal pdfs. In several 
places throughout the paper we will deal with sets of RVs that turn out to be 
pairwise independent, but not jointly independent. 

'We do not specify the exponent here. 
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Section III-C2 that there is still enough independence between 
them for the truncation technique to reveal that 



{ 1 5^32) I > ^/{M -1){K -l)Kt'^ 



(42) 



decays exponentially in t, which is a much stronger con- 
centration result than (41). The importance of the difference 
between (42) and (41) becomes clear if we consider 5^^^'. 
Since S^?^^ is a sum over K independent terms, each of which 
satisfies E[|/„^fc PI /ifc^^P] = 1, Chemoff bounding would 
yield that 

Pjl^f^^ - if > VKt^ 
decays exponentially in t. Applying the union bound to S^^^^ = 

E 



^ (31) 

51 , one can then show that 



"ll^^^i) - /^(M- 1) >{M-l)y/Kt^ 



(43) 



decays exponentially in t. When M and K are large, we would 
now conclude from (41) and (43) that S^^^ = S^^^^ + S^^^) 
deviates around KM with a typical deviation of order MK\fK. 
Since the typical deviations are larger (by a factor of \fK) than 
the mean, the corresponding deviation result is useless. On the 
other hand, if we use the bound (42) combined with (43), again 
assuming that M and K are large, we can conclude that S^^^ 
deviates around KM with a typical deviation of order \fM K + 
M^fK, which is an order of magnitude smaller than the mean. 
As already mentioned, the truncation technique allows us to 
establish useful concentration results for sums with dependent 
terms such as that in (40). 

2) Application of the truncation technique: In this section, 
we demonstrate how the desired concentration results for S*'"*^^ 
and S'^^'^\ defined in (37) and (38), respectively, can be obtained 
by application of the truncation technique. The following results 
will be used in the proof of Theorem 1 and will, therefore, be 
formulated for general C^^'^ and C^-^ f.. 

Analysis of S<^^^\- Consider S^?^\ The variables Xk = 
\fm,k\^ and Yfe^m — |^fc,Thp are exponentially distributed with 
parameter A = 1. Therefore, we have 

pjXfc > a;| = p|lfe,A > a;| < e"^, a; > 0, for all k, m. 

Define „ = Xi~Yk^m- From the union bound for products it 
follows that 

P{^fc,A > a;^} = P{^fclfe,m > .'i;'} < 26"^ 

which yields 

v[Zk,rh >x}< 2e-^. 

Next, using E[Zfe.m] = 1 and E[(Zfe,A)^] = 4 for all k,m^ 
m and the independence of the RVs Zk^^h across k & [1: K], 
it follows from Corollary 2, taking into account (12), that for 
K>2 



K 

E 

fc=i 



where A'^'^^^ = min[l, (1/8)C ] . Applying the union bound 
for sums (see Lemma 2) and using (12), we finally obtain the 
desired'" concentration result for 5^^'^ as 



ij^-Csi) > (M - 1)KC^ + {M - 1)VKx^ 



(44) 



and 



p|5(3i) < (M - 1)KC^ - (M - 1)\/Kx^ 

<6(M-l)ife-^''"^'''. (45) 
Analysis ofS^^'^\- We start by rewriting (38) as 

K 

^ ^Pl'.'fc fv(k).k frn,k ^fc.D(fc) hk,m J^.fc^ (46) 

rh^m k=\ 

where T^^^ is defined as 

rp(32) A 



- x ■ ^m,m r f* h h* 

~ \/ K - 1 ^ Pl>^ ■'p(fc),fc •'m.fe "fc.pCfe) "fe.m- 



k^k 

The concentration result for S'^^'^^ (and other similar sums 
occurring in the proofs of Theorems 1 and 2) will be established 
by applying (one or multiple times) the following general steps: 



Establish a concentration result for T' 



(32) 



m.fc * 



• Represent the terms on the right-hand side (RHS) of (46) 
in the form C™^'™ Zrh,k exp(i^fe,m) where 



Zrh,k — '^'fh,k \fm,k \ |^fe,r7i| 
4>k,m — ^^s(^fp{k),k fm,k ^fc,p(fe) hk,rhj 



and 



so that the sum S^^"^^ can be written as 

K 



m^m k=l 



• Use the concentration result for T?^^ together with the 

union bound for products (see Lemma 5) to establish bounds 
on the tail behavior of Zm,k and verify condition (109) in 
Theorem 10. 

• If needed, split up the sum ^^''^^ into several sums, so that 
the phases exp{j(j)k,m) are jointly independent in each of 
these sums and Theorem 10 can be applied (to each of these 
sums separately). 

• Finally, apply Theorem 10 to each of the sums resulting in 
the previous step separately and use the union bound for 
sums to establish the desired concentration result for 5^'^^) . 

Following this procedure, we start by deriving a concentration 
result for T^^j^. Since T^^^ is of the same nature as S^'^\ we 
could, in principle, use Chernoff bounds. This would, however, 
lead to an exponent with a comphcated dependence on t, which 
can be simplified only imder certain assumptions on t, such as 

^''We note that we do not avoid using the union bound on 5(^^' . It is important, 
however, that we do not use it when analyzing 5^^^' . 
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e.g. t = o[Vk) in (34). What we need is a simple universal 
bound for P{ |T^^^ | > .x}, which is valid for all x and allows 
to verify condition (109) in Theorem 10 for Zjf^ fe. Such a bound 

' (32) 

can be obtained by applying the truncation technique to ^ 
as follows. Define ^ |/^_^|, y^_^ ^ and 

^k,rh - ^'^S{fp{k),k f*m,k ~^k,p{k) H,m) 

SO that 

„(32) _ \ " f-ym,m v pJ't'k rh 

-^m,k - 1 ^ Pl,fc ' ■ 

k^k 

The RVs X-^ and ^j^^ (for all fc, m) are Rayleigh distributed 
with parameter o? ~\ /2. Therefore, we have 

P{x^>x}=p{Ffe_^>x}<e--^ x>0 

and the union bound for products yields 

which shows that condition (1 16) in Corollary 1 is satisfied. Next, 
rewrite 4>t^ as 



^fc,m = arg(4(fe),fe)©axg(/;_J 

®arg(/i^_p(fe)) 



I arg 



(48) 



where ® stands for addition modulo 27r. Because the /'s and 
the /I's in (48) are independent across fee [1 : if ], it follows that 
the phases 0^, ^ are also independent across fee [1 : ii^], which 
is precisely what we need for the truncation technique to be 
applicable. Recalling that m ^ rh, and, therefore, either 7^ 
m or p{k) ^ m, (48) implies that f^j^. ^ ~ U{—'k, tt) and hence 
E[exp(j(/)^ ^)] = for all fc,m. Since (/)^ ^ is independent 
of Xf^ and y^^, we have E [cxpO'^/^fc ^jXjV^^^] = for all 
fc, m and hence E [r^jf 

,(32) 



for all m, fc. Finally, applying 



Corollary 1 to ^, taking into account (12), we get for if > 2 
and a; > that 



{|ri^J|>x}<8(X-l)e- 



(49) 



with A(^) ^ 2-1/3 min 1, (1/2)C" 

We are now ready to establish the concentration result 
for 5(32). First, rewrite (f)k,rh as 

^fe,m = arg(^/*(fe)_j.) e arg(/„,,fc) 

e Bxg(hl^p^k)) ® arg(/ife,m) . (50) 



Similar to 



in (48), because rh ^ m we conclude that 



4'k.m ^ W(— tTjTt). Furthermore, because k ^ k the (t)k,m are 

' (32) ' 

independent of T)^ and therefore also of Z^h k (for all k, rh). 

To apply Corollary 1 to 5*^32)^ ^jjg required to be jointly 

independent across me [1 : M] for m 7^ m and k e [1 : -ft']. 

It can be verified that this is not the case. There is, however, 



a simple way to resolve this problem by considering the two 
disjoint index sets 

-fi = I {rh, k) 

m e [1 : M], rhi^m, k&[l: K], p{k) ^ m| 

m e [1 : M], m^m, k € [I : K], p{k) = m|. 
It follows by inspection that within each of the sets 



^k.rh 



){k,rh)^i, and{.^fc,A} 



{k,m)el2 



the phases are jointly in- 
dependent. Separating 5^32) jj^^g sums corresponding to the 
group of indices Ii and I2, we get 

^(32) _ ^(321) _|_ ^(322) 



(51) 



with 



5(321) 



m^m k:p(k)^m 
mjtm k:p(k)=rh 



PI fe •^TOjfc 



PI fc ^^^k ^* 



Applying the union bound for products first to | /m,fe 1 1 ^fc,m | as 
in (47), then to Zm,k using (49), and using the simple bound 



_A(r)^i/3 



which is valid for a; > 1, we get 

foxK > 2 and a; > 1. Therefore, using E[Z^^fc exp(j^fc = 
for all fc, m 7^ m, applying Corollary 1 to S'''32i) (which 
consists of K{M — 1)2/M terms) and to 5''322) (which consists 
of K{M — 1) /M terms) separately, taking into account (12), we 
obtain that for if > 2, M > 2, and a; > 1 



5(321) 



^^^(j.-l)i.(M-l)2j 



and 



5(322) 



M 



<64(^^ffi^e--^- (52) 



<64(^-WM-l)^_.(3.,v. (53) 



where A(32) = 2-10/21 min[l, (1/2)C ]. Combining (35) 
(and similar bounds for 5(1) and 5(2)), (52), (53), (51), (44), 
(45), and (36), we can now state the final concentration result 
for SINRJ^i by carrying out Step v in the summary presented 
in the first paragraph of Section Ill-C. Recall, however, that we 
used the classical Chemoff-bounding technique to estabUsh the 
large-deviations behavior of S''^i^, S'^'^\ and S'^'^^ whereas we em- 
ployed the truncation technique to analyze the large-deviations 
behavior of 5(3). Even though the Chemoff bounds are tighter 
than the bounds obtained through the truncation technique, the 



10 



^TT^ K 



max 



Lp2{x) 



16 7=?2 M3 

^SN 



7r2 C if 



/M 



3N ^ 



Ck v'A 



SN 

2 



n M-i 



M 



max 



0,1 



/M 



8 



16 7^2 j^j2 4 



_k I ft 



C/p2(a;) ^ 



max 



C2 M-1 



max 



(54) 



(55) 



(57) 



(58) 



tightness of the final bounds for the tail behavior of SINR^^ and 
SINR^^ is determined by the weakest exponent in the bounds 
for the individual terms S^^\ S^^\ S'^^'> and S^^\ Therefore, 
employing Chernoff bounds for S'^^\ S^'^\ and S^^^ and the 
truncation technique for S''-'^-' will not lead to a significantly 
tighter final result, compared to the case where the truncation 
technique is used throughout. Motivated by this observation and 
for simplicity of exposition, we therefore decided to state the 
concentration results in Section III-D for SINR^^ and SINR^^ 
obtained by applying the truncation technique throughout. 



D. Concentration Results for PI and P2 

In Section III-C, we outlined how the large-deviations behav- 
ior of the SINR (for PI and P2) can be established based on the 
truncation technique and on union bounds. The resulting key 
statement, made precise in Theorems 1 and 2 below, is that the 
probability of the SINR falling outside a narrow interval around 
its mean is "exponentially small". We proceed with the formal 
statement of the results. 

Theorem 1: For any if > 2, M > 2, for any x > 1, the 
probability Pvi{x) of the event 

SINRPI ^ [Lpi {x) , Uvi {x)] , m e [1 : M] 

where Z/pi(a;) and f/pi(a;) are defined at the top of the page 
in (54) and (55), respectively, with the constants Csn and C_^-^ 
given by 

satisfies the following inequality 

Pvi{x) < 302 if ^Me-^Pi (56) 

with Api ^ min[2-n, l/(2iTc'), 1/(8C^), l/(4c4) 
Proof: See Appendix C. 
Theorem 2: For any if > 2, M > 2, for any x > 1, the 
probability Pp2{x) of the event 

SINRP2 ^ [Lp2 {x),Up2{x)], m e [1 : M] 



where Lp2{x) and Up2{x) are defined at the top of the page in 
(57) and (58), respectively, satisfies the following inequahty 



Pp2{x) < SUK^M-^ 



(59) 



with Ap2 = min 



2-^,l/(2McO,l/(8C^),l/(4c^ ^ 
Proof: The proof idea is the same as that underlying the 
proof of Theorem 1 with large parts of the proof itself being very 
similar to the proof of Theorem 1 . For the sake of brevity the 
details of the proof are therefore omitted. ■ 
The concentration results in Theorems 1 and 2 form the basis 
for showing that, provided the rate of growth of if as a function 
of M is fast enough, the network "decouples" (see Theorems 3 
and 4) and "crystallizes" (see Theorem 5). Moreover, as outlined 
in Theorem 5, the outage capacity behavior of the Sm — > T^m 
links can be inferred from (56) and (59). 

IV. Ergodic Capacity and Cooperation at the Relay 

Level 

The focus in the previous section was on establishing concen- 
tration results for the individual link SINRs for PI and P2. Based 
on these results, in this section, we study the ergodic capacity 
realized by the two protocols and we establish the corresponding 
capacity scaling and outage capacity behavior. 

A. Ergodic Capacity of PI and P2 

Throughout this section, we assume that all channels in the 
network are ergodic. The two main results are summarized as 
follows. 

Theorem 3 (Ergodic capacity of PI): Suppose that destina- 
tion terminal T>^ (me [1 : M]) has perfect knowledge of the 

mean of the effective channel gain of the Sm — > "Dm link, given 

by (7r/(4V7?))Efe:K/i)=- ^pi,!' ^hen, for any e, (5 > there 
exist Mo, ifo > s.t. for all M > Mq, if > ifo, the per source- 
destination terminal pair capacity achieved by PI satisfies 



1 



log 1 



TT^ Of if 

16 M3 



(1 



PI 



max[iC, M2+'5] 



16 



SN 



M3 



+ 



(60) 
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Theorem 4 (Ergodic capacity of P2): Suppose that destina- 
tion terminal T>m {rn € [1 :M]) has perfect knowledge of the 
mean of the effective channel gain of the Sm T^m link, given 
by (7r/(4/?0?))X;f^i Cp2'7. Then, for any e,5 > there 
exist Mo,Kq > 0, s.t. for all M > Mq, K > Kq, the per 
source-destination terminal pair capacity achieved by P2 satisfies 



It then follows that for any M > Mq, the inequahty 



> 



(1-e) 



2 ^2 



1 , / . ^ 



SN 



K 



(1 - e) < a 



P2 



(61) 



The proofs of Theorems 3 and 4 are very similar. Below we 
present the proof of Theorem 3 only. The proof of Theorem 4 is 
omitted. 

Proof of Theorem 3: We start by establishing the lower 

bound in (60), the proof of which uses the result summarized in 
Appendix E. To apply Lemma 7 in Appendix E, we start from (7) 
and define 

1 ^ 

fc=i 

K 



771 A -1 \ ^ / m,m TTTir m,m-\\ 



fe=i 



w„ 



rh^m 



K K 

'-Y,H'"' + ^Y.^k^k + Wm. Where we define 



is satisfied, which together with (62) completes the proof of the 
lower bound. 

Proving the upper bound on Cpi in (60) turns out to be 
significantly more challenging. The method we use to this end 
is based on the concentration result for SINR^^ in Theorem 1 . 
We start by noting that the per-stream ergodic capacity can be 
upper-bounded by assuming that 2?^ has perfect knowledge 
of H and F, i.e., 

CP1< ^EH,F[A2/m;Sm|H,F)] 

= ^EH,F[log(l + SINRPi)] 

< ^log(l + EH,F[SINRPi]) 

where the last step follows from Jensen's inequahty. 

Now fix e > 0. To prove the upper boimd in (60), it suffices 
to show that there exist Mo,Kq> Q s.t. for all M > Mq and 

K>Ko 

Eh,f [SINRPI] < A L_ J (1 + e) 



fe=l ^ fe=l 

With these definitions, we can now rewrite (7) as 

Fm. ~\~ -^m^ ~t~ ^^m- 

Straightforward, but tedious, manipulations yield 

F 
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SN 



-0 



k:p{k)='m 



Var 



Frr 



TT 

16 



k:p{k)=m 



To simphfy the exposition, we define 
1 

Note that we make the dependence of SINR^^ on M and K 
exphcit by using the notation SINR^^(M, iiT). In the remainder 
of the proof, we show that 



EH,F[5(M,i^)] < 1 + e 



(63) 



Var[H^„ 



1 



K 



m^m k=l 



fe=i 



for M and K large enough. Let fg {x) denote the pdf of g{M, K) . 
Then, the expectation Eh,f [g{M, K)] can be written as 

/>oo 

EH,F[5(M,ir)]= / tfg 

Jo 

r-l+e 



Next, we use (12) and (13) to lower-bound Fm and upper- 
bound Var [Fm] and Var [Wm] , substitute the resulting bounds 
into (150), and obtain" 



tfgit)dt 

= / tfg{t)dt+ / tfg{t)dt (64) 

Jo Jl+ei 



I{ym; Sm) > o log 1 + =2" 

2 V ^^il/M)C 



K 



7^2 M3 



(62) 



Finally, fix e > and set 



where ei > is chosen s.t. 

1 + ei < 1 + e/3. 
Consequently, we have 



/ ^\fg{t)dt<{l + ei) [ fg{t)dt 

Jo Jo 

<l + ei<l + e/3. (65) 

For bounding the second integral on the RHS of (64), it 
is convenient to write the upper bound in Theorem 1 in the 



Mo = 



1-e r 



SN 



''We note that this bound is valid for arbitrary M and K and is, therefore, 
somewhat stronger than the asymptotic bound we are actually seeking. 
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K 



1 + Ai^=x 



0, 



M -1 



M 



A2X 



+ (?a^ max 



0,1- 



(67) 
(68) 



following form: there exist A > 0, 5i > 0, > 0, and Trivially, we have 

Ai, A2, A3 > such thatfor any X > 1 and M,if > 2 ^.^ M''iii'*^e"'^(^(^))'^'' = 

P|£,(M,K) > B(M,if,a;)| < AsM'^^i^r-'^e-^^"^' (66) M.jf^oo 

^ ' and, therefore, there exist M^^^^ K^^'^'^ > s.t. for any M > 

^ ^ ^^^(^ Mr and.,;.- 

^ ' ' ^ B^{M,K,x) A3M^^i.*=e-^(-W)^'' < (73) 

where B^{M, K, x) and B'^{M, K, x) are defined at the top ^72) and (73) and settin " 

of the page in (67) and (68), respectively. The second integral °™ inmg ( ) an ( ) an setting 

on the RHS of (64) will be shown, for M and large enough, M^^^ = max[M^^^^ , M^^'^^] , K^^'^ = maxf^f^^^^ K^^'^^] 

to be upper boimded by 2 e/3 by splitting it up and proving that , ^ , ju , ,,fil 

we get that for any M > M^^ and ii^ > /C^^ 

tfg{t)dt < e/3 (69) \to] P{5(M, if) > 1 + ei} < e/3 (74) 

which concludes the proof of (69). 



/•oo 

/ tfg{t)dt<e/3 



To show (70), we note that 



/ t fg{t)dt < V (n + 1) P g{M, K)>n\^S. (75) 



(70) 

where the parameter to > 1 + ei, independent of M, K, will j ^^^-^ 
be chosen later. It will become clear later why we need to spUt "-r*ol 
up the second integral on the RHS of (64) according to (69) Expanding the square, upper-bounding x by x^ in B^{M, K, x) 
and (70). The integral in (69) can be bounded as follows and substituting the max terms in B^ (M, K, x) by 0, we obtain 

4*0! r\to] 



the bound 

B(M, K, .x) 



tfg{t)dt< \to\ f ° ,fg{t)dt 

Set x(M) = (min[yM,M''])^^^. With this choice of x(M), =Bi{M,K,x^). (76) 

it is not difficult to show that 

Applying the change of variables y = x in (76) and (66), we 
lim Ai ' = finally get 

lim A2^^=0 F[g{M,K)>B,{M,K,^)} 



lim 



<F\g{M,K)>B{M,K, 



M,K^c^(f^K <AsM^^K^'e-^y . {11) 

which yields Equating Bi (M, K, y) with n and solving for y, we find that 

^lim^B-(M,if,x(M)) = ^lim^ ^^^k,M^,s^ ^ ' ^ ^ AsM^^if^^e^^-^--.-))- 

2 ^2 9/9 \ "^^^ 

Using CgN = £ + tr ie + 1), we can furthermore conclude ,1^,^2+5, / 2 \ 

^1 ^ max[K,JM j / CT X 1 

lim B^(M,if,x(M)) = l y2(n,M,if)= ,4 m\ 42M^ ^-(78) 

which, together with (71), impUes that Now, S defined in (75) can be upper-bounded as 

lim B(M,K,xiM)) <l. a ^ ^ mr ^ 1 

M,K^oo V . ; V - S<2 nF{g{M,K)>n} 

We can, therefore, conclude that there exist M^^^^ , k'^^^ > " ^ 

s.t. for any M > M^"' and > JT^"^ < 2A3M^^K^^ ^ ^^-A{y2{n,M,K)y^\ 

B{M, K, x{M)) <l + ei. (72) "=r*ol 
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If n is s.t. (T^n/CgN > 1, then the expression in the parentheses 
in the numerator of (78) is strictly positive and it follows that 
liniM.if^oo y2{'n, M, K) = oo. Therefore, if is chosen s.t. 
\to\ > C'sn/"'^' ^^'-h term in the sum in (79) goes to zero 
exponentially fast 'mM,K. Note that the split-up in (69) and (70) 
was needed to be able to choose large enough here. To simplify 
the exposition in the following, we set Iq = (2^ + l) Cgnj/a^, 
so that 

' K 

for n> \to\. Next, we note that 

max[K, M^+^] 1 



1/7 



> 2 



lim 



K 



so that there exist M^\k'^'' > s.t. for any M > 



OA. ^ -I- 42M2 



(2) 



^max[/r,M2+'5] 



1/7 



> 2. 



Now using that, trivially, 

xy>x + y 

for x,y > 2, we have for any M > M^, K > K^'' and 
n > ito] 

{y^{n,M,K)f" 



> 



K 



C: 



-n — 



SN 



max[K, M2+'5] 



1/7 



+ 



'max[/r,M2+'5] 



1/7 



which yields 



S < 2A3M^'K^^e 



K 



^^1 ^+^1 K 



MVA' + Af 



n=[tol 



with 



/i(n) = nexpj —A 



p2 



1 



1/7N 



Clearly, h{n) decays fast enough for X^i^Lptol ^i''^) converge 
to a finite limit, in other words, there exists a constant C < oo 
(independent of M, K) s.t. 



Moreover, it is easily seen that 



(80) 



lim M^^K^^e 



max[Jf,M2 + ^] j 



-1/7 







which, together with (80), shows that S can be made arbitrarily 
small by choosing M and K large enough. More specifically, 
there exist M^^\ iC^^' > s.t. for any M > M^^^ and K > 



(3) 



S < e/3. 



(81) 



Taking 

and combining (65), (74), and (81), we have shown (63), which 
completes the proof. ■ 

B. The " Crystallization" Phenomenon 

As pointed out in the introduction, the "crystallization" phe- 
nomenon occurs for M, if oo, provided that K scales fast 
enough as a function of M, and manifests itself in two effects, 
namely, the decoupling of the individual hnks and 

the convergence of each of the resulting SISO links to a nonfading 
link. 

1) Decoupling of the network: Theorems 3 and 4 show that 
in the M, ii" ^ oo limit, the per-source destination terminal 
pair capacity scales as Cpi = (1/2) log(l + Q{K/M^)) in PI 
andCp2 = (l/2)log(l + e(is:/M2)) in P2. We can, therefore, 
conclude that if K (x M^+" in PI and K 3c AP+" in P2 with 
a > 0, apart from the factor 1/2, which is due to the use of two 
time slots, PI and P2 achieve full spatial multiplexing gain [30] 
(i.e., full sum-capacity pre-log) without any cooperation of the 
terminals in the network, not even the destination terminals. The 
corresponding distributed array gain (i.e., the factor inside the 
log) is given by M" in both cases. 

The fact that the per source-destination terminal pair capacity 
is strictly positive when K scales at least as fast as in PI and 
at least as fast as in P2 shows that the individual Sm T^m 
links in the network "decouple" in the sense that the SINR is 
strictly positive for each of the Unks. Note that this does not imply 
that the interference at the Vm (created by Sm with rh ^ m) 
vanishes. Rather, if K scales fast enough, the signal power starts 
dominating the interference (plus noise) power. Since both upper 
and lower bounds in Theorems 3 and 4 exhibit the same scaling 
behavior, the K oc and K oc M^, respectively, thresholds 
are fundamental in the sense of defining the critical scaling rate 
by delineating the regime where interference dominates over the 
signal and hence drives the per source-destination terminal pair 
capacity to zero from the regime where the signal dominates 
the interference and the per source-destination terminal pair 
capacity is strictly positive. Further inspection of the upper and 
lower bounds in (60) and (61) reveals that, for fixed e > 0, 
unless all path-loss and shadowing coefficients Ek m and Pm.k 
(k G [l:K],mG [l:M]) are equal and hence C = (f and 
CsN = £sN' there is a gap (apart from that due to e > 0) 
between the bounds. 

The order-of -magnitude reduction in the threshold for critical 
scahng in P2, when compared with PI, comes at the cost of each 
relay having to know all M backward and M forward channels. 
We can, therefore, conclude that PI and P2 trade off the number 
of relay terminals for channel knowledge at the relays. 

Finally, it is worthwhile to point out that in contrast to 
the finite-M results for PI in [1], the destination terminals 
Vjji do not need knowledge of the fading coefficients hk,m 
and fm k- This can be seen by noting that the quantity 
{n/{4^/K)) Ek:pik)=m C^Pi.T. which has to be known at 
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depends on Ek.m, Pm,k, K, and M only. Moreover, the co- 
efficient (tt/ (4v^)) Z]fe:p(fe)=TO C'pi.T easily be acquired 
through training. 

2) Convergence to nonfading links and "crystallization" : 
When the network decouples, it is interesting to ask how the 
decoupled SISO links behave (in terms of their fading statistics) 
when M and K grow large. The answer to this question follows 
from the concentration results in Theorems 1 and 2, which can be 
reformulated to establish upper bounds on the outage probability 
for the individual Sm T^m links. For the sake of brevity, we 
focus on PI in what follows. The goal is to arrive at a statement 
regarding 

Pout,Pi(i?) = P| ^ log(l + SINRP^) < R 

= P{SINR^i < 2^^ - 1} . 

The corresponding result is summarized in 
Theorem 5 ( Outage probability for PI ): 
1) Assume that K >2,M > 2, and i? > are s.t. 

1 - epi(M, K, R) 



x{R) 



§,^ + eMM,K,R)(^= 



1 

/m 



/K 



> 1 



(82) 



where 



epi(M, K, R) 



16 a 



SN -"^ 



7r2 K 



Then, the individual link outage probabihty is upper- 
bounded as 



2/7 



(83) 



2) Under the same conditions on K, M and R as in 1), for 

any e, ^ > 0, if > M^+\ and 



K 



(1-e) 



SN 



we have 



J'outPi(^)< lim 151if2Me-^Pi^(^) 
' M,/sr— >(x) 



2/7 



(84) 



0. 



Proof: We start with the proof of statement 1). Recall 
that Theorem 1 provides us with a parametric upper bound on 
P{SINR^^ < Lpi{x)} with Lpi{x) defined in (54). Assuming 
that 

- < (85) 
- 16M ^ ^ 

and using , we can lower-bound Lpi {x) 

as 



Lpiix) > T^ — 



7r2 K 



1 _ 16 M 



Solving 



16 1 -I 3 £ u 



2^«-l = i'p,(x) 



L'p^{x). 



for yields (82), which, by assumption, satisfies x{R) > 1. 
With 

pjsiNR^i < Lpi(x)} < p{sINRP^ < Lpi(a;)} 
we can now apply^^ Theorem 1 to obtain 



(87) 



Finally, we note that x{R) in (82) is trivially seen to sat- 
isfy (85). This concludes the proof of statement 1). 

The proof of statement 2) is obtained by estabhshing a suffi- 
cient condition on x{R), for any i? > 0, to grow with increas- 
ing M (and by if > M'^+^ with increasing K). Using (82), it 
is easily verified that guaranteeing 

< epi{M,K,R) < 1 - e 

for some < e < 1 (independent of M, K) provides such a 
condition. The final result is now obtained by solving 



epi{M,K,R) 



16 M3 



K 



- 1) < 1 



for R. ■ 

The implications of Theorem 5 are significant: For any trans- 
mission rate R less than the ergodic capacity (in the case 
Ek. ,fc for all fc, m) or the ergodic capacity lower 

bound in Theorem 3 (in the case of general Ek,m and Pm^k), 
the outage probabihty of each of the decoupled links goes to 
zero exponentially fast in the number of nodes in the network, 
provided K scales supercri tic ally in M. We have thus shown that 
choosing the rate of growth of K fast enough for the network 
to decouple automatically guarantees that the decoupled SISO 
links converge to nonfading links. Equivalently, we can say that 
each of the decoupled links experiences a distributed spatial 
diversity (or, more precisely, relay diversity) order that goes 
to infinity as M oo. Consequently, in the large- Af limit 
time diversity (achieved by coding over a sufficiently long time 
horizon) is not needed to achieve ergodic capacity. We say that 
the network "crystallizes" as it breaks up into a set of effectively 
isolated "wires in the air". From (83), we can furthermore infer 
the "crystallization" rate, i.e., the rate (as a function of M and K) 
at which the individual S„i T^m links converge to nonfading 
links. We note, however, that the exponent 2/7 (and 2/9 forP2) is 
unlikely to be fundamental as it is probably a consequence of the 
application of the truncation technique. In this sense, we can only 
specify a guaranteed crystallization rate. We conclude by noting 
that the upper bound (87) (as well as the corresponding result for 
P2) tend to be rather loose. This is probably a consequence of the 
truncation technique and the use of union bounds to characterize 
the large-deviations behavior of the individual Unk SINR RVs. 

Numerical results: We shall finally provide numerical re- 
sults quantifying the outage behavior of P 1 and P2. For simplicity, 
we set Ei~^rn = Pm,k = 1 for all m, k and ct^ = 0.01 in 
both simulation examples. This choice for the path loss and 
shadowing parameters, although not representative of a real- 
world propagation scenario, isolates the dependence of om 



'^Strictly speaking, one needs to use the upper bounds on 
(86) p{SINRP1 < Lpi (x)} derived in the last paragraph of Appendix C. 



15 



V 



1 

0.9 
0.8 
0.7 
0.6 

0.5 



0.3 
0.2 
0.1 








M = 35 














\ 






M = 






. . . . 












20 




. . . . 


























~M 


= 5 


















. . . . 
















. . . - 






















; limiting CDF 





















0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2 

X 



VI 



0. 
0. 








M = 35 


























M = 




































= 5- 
























































.4 ; limiting CDF 



















0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2 

X 



Fig. 3. Simulated (Monte-Carlo) SINK CDFs for different values of M for (a) 
X = M3 in PI and (b) K = in P2. 



results on the network geometry. Moreover, it ensures that the 
distribution of the different SINR RVs for a given protocol is 
identical for all links so that it suffices to analyze the behavior of 
only one SINR RV for each of the two protocols. For K = in 
PI and K = in P2, Fig. 3 shows the cumulative distribution 
functions (CDFs) (obtained through Monte-Carlo simulation) of 
SINRP^ and SINR^^ respectively, for different values of M. 
We observe that, for increasing M, the CDFs approach a step 
function at the corresponding mean values, i.e., the SINR RVs, 
indeed, converge to a deterministic quantity, and, consequently, 
the underlying fading channel converges to a nonfading channel. 
The limiting mean values are given by the lower and upper 
bounds (which coincide in the case Ek^m ~ Pm,k = 1 for 
all m, A:) in (60) and (61) for PI and P2, respectively. We can 
furthermore see that for fixed M the CDFs are very similar for 
PI and P2 (recall, however, that K = A'P in PI and = 
in P2), suggesting that the convergence behavior is similar for 
the two protocols. The difference in the theoretically predicted 
convergence exponents (2/7 for PI and 2/9 for P2) therefore does 
not seem to be fundamental to the two protocols and may, indeed, 
be a consequence of our proof technique as already pointed out 
above. 



C. Cooperation at the Relay Level 

The analysis carried out so far was based on the assumption 
that the relays cannot cooperate. The purpose of this section 
is to investigate the impact of cooperation (in fact, a specific 
form of cooperation) at the relay level on the ergodic-capacity 
scaling behavior in the coherent case. Note that we continue to 
assume that the destination terminals cannot cooperate. Before 
proceeding, we would like to mention that concentration results 
and an outage analysis along the lines of the discussion in 
Sections III and IV-B are possible, but will be omitted for brevity 
of exposition. 

Cooperation at the relay level will be accounted for by group- 
ing the K single-antenna relay terminals into Q groups 

Qq = ^TZ(g-l)L + l,T^iq-l)L+2, ■ ■ ■ :T^qL^, 9 € [I : Q] 

with L relays in each group and by assuming that the relays in 
each group can fully cooperate, but cooperation across groups 
is not possible. In order to simplify the exposition, in the re- 
mainder of this section, we think of a group Qq {q G [1 : Q]) as a 
single relay element with L antenna elements and use the term 
"vector-relay (v -relay)" terminal to address the L-antenna relays 
Qi, 02, • • • , Gq. For g G [1 : Q] and to G [1 : M], the following 
notation will be used: 



A 

r„ = 



A 

Z„ = 



r{q-l)L+l,r(q^l)L+2, rqL] 



q-l)L+l,t(q-l)L+2 



A r iT 
"g — Z(q-l)L+2, ZqL\ 

ii-q,rn = [^(g-l)i+l,m) f^{q-l)L+2,mi • • • ) ^gL.m]'^ 

^m,q [fm,{q—l)L+lj fm,{q—l)L+2i • • • i fm,qL\ 

where and tq are the (i-dimensional) vector-valued signals 
received and transmitted by the qth v-relay, respectively, Zq is 
additive noise at the gth v-relay, hq^m contains the channel gains 
for the S„i Qq link, and f^.q contains the channel gains for 
the Qq T>m link. Additionally, for simplicity, we assume that 
relays belonging to a given group q are located close to each 
other so that 



{q-l)L+2,m 



Pm,q — Pm,{q-1)L+1 — Pm,{q-l)L+2 — ■ ■ ■ — P, 



EqL,m 
m,qL 



for q e [1 : Q] and m G [1 : M]. With this notation, the I-O 
relations (1) and (2) for the Qq links and the Qq 

links can be written as 



M 



= ^ Eq^rn\,mSm + Zg, qG[l:Q] 



and 



Q 

— ^ ^ Pm,q^m,q^<l "I" 
9=1 



TO e [1:M] 



respectively. Next, we describe the generalization of the pro- 
tocols PI and P2 to the case of v-relay s making the aspect of 
cooperation at the relay level explicit. 

'^For simplicity, we assume that Q divides K so that K = QL. 
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1) PI for the Cooperative Case: Like in the case of single- 
antenna relays (described in Section III-A), we partition the 
Q v-relay terminals into M subsets Mm {m € [l-M]) with^"' 
l-A^ml = Q/M. The v-relay s (each of which has L antenna ele- 
ments) in Mm are assumed to assist the mth source-destination 
terminal pair {Sm,T^m}, and the relay partitioning function 
p : [1, Q] ^ [1, M] is defined as 

p[q) ^m^gq GMm- 

We assume that the qlh v-relay terminal has perfect knowledge 
of the phases of the single-input multiple-output backward chan- 



nel S, 



pii) 



Qq and the phases of the corresponding multiple- 



input single-output forward channel Qq 
that perfect knowledge of the vectors 



■Dp(q) . This implies 



(K,p(?)]i) ^ gja'-g([h„p(9)]2) . 



3arg([h,,p(<,)]^) 



and 



„jarg([fp(,)_,] J gjarg([fp(,)_,]J 



... pjarg([fp(,),,]^) 



is available at Qq. The signal received at the qlh v-relay termi- 
nal is phase-matched-filtered first w.r.t. the assigned backward 



channel S, 



pig) 



Qq and then w.r.t. the assigned forward channel 



Qq T^p{q) followed by a normalization so that 



tg - dvi,q fp^q^^q (h^p(g) Tq^ 



(88) 



where the choice 




-1-1/2 



Eq,p{q) + Q(T^ 



ensures that the per-v-relay power constraint E[||tq||^] = 
Piei/Q {q ^ [1 • Q]) and consequently the total (across v-relay s) 
power constraint ^ [W^q \f] — ^rei is met. As in the single- 
antenna relay (i.e., noncooperative) case, PI ensures that the 
relays Qq & Mm forward the signal intended for Dm in a 
"doubly coherent" (w.r.t. the assigned backward and forward 
channel) fashion whereas the signals transmitted by the source 
terminals Sm with m ^ m are forwarded to Vm in a "non- 
coherent" fashion (i.e., phase incoherence occurs either on the 
backward or the forward link or on both links). From (88), we 
can see that cooperation in groups of L single-antenna relays 
is realized by phase combining on the backward and forward 
links of each v-relay. More sophisticated forms of cooperation 
such as equahzation on the backward link and precoding on the 
forward link are certainly possible, but are beyond the scope of 
this paper. 

''^For simplicity, we assume that M divides Q. 

"The quantity (ipi,q, used in this section is (for L > 1) different from dpi^^ 
defined in (5). We use the same symbol for notational simplicity and employ 
the index q (instead of k) consistently, in order to resolve potential ambiguities. 
The same comment applies to other variables redefined in this section. 



2) P2 for the Cooperative Case: Like in the case of single- 
antenna relays (i.e., the noncooperative case), P2 requires that 
each relay, in fact here v-relay, knows the phases of all its M 
vector-valued backward and forward channels, i.e., Qq needs 
knowledge of hg.„, and fm,q, respectively, for m € [1 : M]. The 
relay processing stage in P2 computes 



\to=1 / 



where 



dv2,q — 



M 
m=l 



AM 



M 
m=l 



-1/2 



ensures that the per-v-relay power constraint E[||tq||^] = 
Prei/Q (5 € [1 : Q]) and, consequently, the total (across relays) 
power constraint X^^^i E[||tq||^] = Pj-ei is met. 

3) Ergodic-Capacity Results: We are now ready to establish 
the impact of cooperation at the relay level on the ergodic 
capacity scaling laws for PI and P2. Our results are suimnarized 
in Theorems 6 and 7 below. 

Theorem 6 (Ergodic capacity of PI with cooperation): 
Suppose that destination terminal Vm {m £ [1:M]) has perfect 
knowledge of the mean of the effective channel gain of the 



Vm Unk, given by {TT/4.)L^J2q:p(q)=m dpi,qPm,q 



q^TTi' 



Then, for any e,5 > 0, there exist Mo,Qo > s.t. for all 
M > Mq and Q > (5o the per source-destination terminal pair 
capacity achieved by PI satisfies'^ 



;l0g 1 



<2log 



QL2 



16 M3 



C 



(l-e) <C, 



PI 



SN 



^16 M3 cl ^ 



(89) 



i-SN 



Theorem 7 (Ergodic capacity of P2 with cooperation): 
Suppose that destination terminal Vm {m £ [1 : M]) has perfect 
knowledge of the mean of the effective channel gain of the 

Sm Vm fink, given by (7r/4)L2^^^^ dp2^qPm,qEq^m- 

Then, for any e,6 > 0, there exist Mq, Qo s.t. for all M > Mq, 
Q > Qo the per source-destination terminal pair capacity 
achieved by P2 satisfies 



1 f^TT^QL^C' 
2^°sl'+16M^^ 



(1 



P2 



SN 



<2log| 



TT max 



L2 C 



16 



M2 



C 



(1-e) ■ (90) 



SN 



Proof of Theorems 6 and 7: The upper bounds in (89) 
and (90) are again established based on a concentration result 
for the individual link SlNRs and the lower bounds build on 
the technique summarized in Appendix E. The proofs of Theo- 
rems 6 and 7 are almost identical to the proofs of Theorems 3 

'*Note that the quantities Csn, C, C, and used in this section have 
been defined in Section HI. 
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and 4, respectively, and do not require new techniques. There is, 
however, one important aspect in which Theorems 6 and 7 differ 
from Theorems 3 and 4, namely, the appearance of the factor 
in (89) and (90). To demonstrate where this factor comes from, 
we provide the proof of the ergodic capacity lower bound for PI 
in Appendix D. The proofs of the remaining statements will be 
omitted for brevity of exposition. ■ 
Discussion of results: Just like in the noncooperative (i.e., 
single-antenna relay) case, we can conclude that asymptotically 
in M if if oc M^+°' in PI and cx M2+« in P2 with a > 0, 
the network decouples. 

The effect of cooperation (through phase matched-filtering) at 
the relay level manifests itself in the presence of the factor in- 
side the log in the bounds for Cpi and Cp2 stated in Theorems 6 
and 7, respectively. We can summarize the results of Theorems 6 
and 7 as" 



PI 



e 



Cp2 = ^iog(i + e 



M2 



We can, therefore, conclude that the per-stream array gain A is 
given by Api = QL'^/N'P for PI and Ap2 = QL'^/A'P for P2. 
On a conceptual level, the array gain can be decomposed into a 
contribution due to distributed array gain. Ad, and a contribution 
due to cooperation at the relay level (realized by phase matching 
on backward and forward links), Ac, i.e., A — AdAc with 
Ad,pi = QL/M^, Ad,P2 = QL/M"^, and A^^pi = Ac,p2 = L. 
To illustrate the impact of cooperation at the relay level, we 
compare a network with K noncooperating single-antenna relays 
to a network with a total of if = QL single-antenna relays 
cooperating in groups of L single-antenna relays. In the case 
where there is no cooperation at the relay level, we have 

whereas if the relays cooperate in groups of L single-antenna 
relays, we get 



c: 



PI 



1 



log 1 



Cooperation at the relay level (realized by phase matched- 
filtering) in groups of L single-antenna relays therefore yields 
an I;-fold increase in the effective per-stream SINR due to 
additional array gain given by Ac = L. Equivalently, the total 
number of single-antenna relays needed to achieve a given per 
source-destination terminal pair capacity is reduced by a factor 
of L through cooperation in groups of L single-antenna relay 
elements. The conclusions for P2 are identical. 

As already pointed out above, the network decouples into 
effectively isolated source-destination pair links for any finite 
L > 1. Even though a concentration analysis along the lines of 
Theorems 1 and 2 was not performed (for the sake of brevity), it 

'^Note^that we use the 0( ) notation only to hide the dependence on E, E, 
P, and P. Strictly speaking, as L is finite it should also be hidden under the 
0( ) notation. However, our goal is to exhibit the impact of cooperation at the 
relay level on Cpi and Cp2, which is the reason for making the dependence 
on L expUcit. 



VI 

Pi 




Fig. 4. Simulated (Monte-Carlo) SINR CDFs for different values of M for 
QL = in PI with L = 1 and L = 4. 



can be shown that for finite L > 1 the individual links converge 
to nonfading links as M, Q oo, provided that Q scales 
supercritically as a function of M. 

Numerical example: We conclude this section with a nu- 
merical example that demonstrates the impact of cooperation 
at the relay level, where we use the same parameters as in the 
simulation examples at the end of Section IV-B. Figure 4 shows 
the SINR CDF for PI with i: = 4 and Qi: = (the case 
L = 1 shown in Fig. 3 is included for reference). We observe 
that, as pointed out above, for increasing M, we, indeed, get 
convergence of the fading link to a nonfading link. Moreover, 
we can also see that increasing L for fixed M results in higher 
per source-destination terminal pair capacity, but at the same 
time slows down convergence (w.r.t. M and hence also Q) of 
the link SINRs to their deterministic limits. 

V. Noncoherent (AF) Relay Networks 

So far, we have considered coherent relay networks, where 
each relay terminal knows its assigned backward and forward 
channels (PI) or all backward and forward channels (P2) per- 
fectly. In the following, we relax this assumption and study 
networks with no CSI at the relay terminals, i.e., noncoherent 
relay networks. In particular, we investigate a simple AF architec- 
ture where the relay terminals, in the second time slot, forward 
(without additional processing) a scaled version of the signal 
received in the first time slot. As already mentioned in Section 11, 
the source terminals do not have CSI. The destination terminals 
cooperate and perform joint decoding. The assumptions on CSI 
at the destination terminals wiU be made specific in Section V-B. 

A. The AF Protocol 

Throughout this section, we assume that Ek^rn = Pm,k = 1 
for all m e [1 : M], fc e [1 : ii']. This assumption is conceptual 
as the technique used to derive the main result in this section 
does not seem to be applicable for general and Pm,k- On 
the other hand, the results in this section do not require H 
and F to have Gaussian entries. Upon reception of Vk, the 
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A;th relay terminal simply scales the received signal to obtain 
tk = {d/VK)rk. Choosing d = ^/Prci/{1 + <J^) ensures that 
the per-relay power constraint E[|ifcp] < Prei/-f^ and hence 
the total power constraint E[||t||^] < Prei is met. 

With these assumptions, inserting (1) into (2), we get the 
following I-O relation 

y = ^FHs + -^Fz + w. (91) 



K 



K 



In the remainder of this section, we assume that the jointly 
decoding destination terminals have access to the reahzations 
of H and F. In fact, as the analysis below shows, knowledge 
of FH and F is sufficient. 

B. Capacity of the AF Protocol 

Based on the 1-0 relation (91), we shall next study the behavior 
of J(y ; s I FH, F) when M,K ^ oo with K/M 13. We start 
by noting that 

7(yis|FH,F) 

Since the destination terminals perform joint decoding, the 
ergodic capacity per source-destination terminal pair is given by 

K 



Caf = 2 ^ 



where 



fc = l ^ ^ 



(92) 



K 



d^ 

1+ ^FF 



H 



and the factor 1/2 in (92) results from the fact that data is 
transmitted over two time slots. 

C. Asymptotic Capacity Behavior 

To compute Caf in the M,K ^ oo limit with K/M (3, 
we start by analyzing the corresponding asymptotic behavior 
of Aft((l/M)HH^T). To this end, we define the empirical 
spectral distribution (ESD) of a matrix (random or deterministic). 

Definition 1: Let X G C^^^ be a Hermitian matrix. The 
ESD of X is defined as 



1 



N 
n=l 



For random X, the quantity F^{x) is random as well, i.e., it 
is a RV for each x. In the following, our goal is to prove the 
convergence (in the sense defined below), when M, K ^ oo 
with K/M ^ /? and /3 e (0,oo), of F(f/M)HH« 

rj.{x) to 

a deterministic limit and to find the corresponding limiting 
eigenvalue distribution. 

Definition 2: We say that the ESD F-^ (x) of a random Her- 
mitian matrix X S C^^^ converges almost surely (a.s.) to a 
deterministic limiting function Px(a^)> when A'^ oo, if for 
any e > there exists an A^o > s.t. for all N > Nq a.s. 



snp\Fi{x) 



F^{x)\ < e. 



To prove the convergence of F^ ^ ^'^■^■^h ^(^^^ to a deterministic 
limiting function, we start by analyzing F^{x). 

Lemma 1: For M,K oo with K/M /?, the ESD 
F^{x) converges a.s. to a nonrandom limiting distribution 
Ft(x) with corresponding density given by^^ 



Mx) 



V(l + 7i)(l + 72) 
2TTd'^x{l - x)^ 




71 



1 



S{x) (93) 



■72 /V J^ + 7i. 

where 71 = ^^(1 - 1/^)^ and 72 = ^^(l + l/^)\ 
Proof: We start with the singular value decomposition 

^ F = USV 



K 

where the columns of U s £^m,m eigenvectors of 

the mati-ix {d'^/K)FF^, the columns of e C^'-^ are 
the eigenvectors of {d'^/K)F"F, and the matrix S e M^-^ 
contains R = min(M, K) nonzero entries Sn, E22, • • • , ^rr, 
which are the positive square roots of the nonzero eigenvalues 
of the matiix {d'^/K)FF". Defining A = SS^ e 
have 

T = V-^S-^ (I + A)"^SV. 



bM,M 



, we 



By inspection, it follows that 



^ 1:^(1+ A)- 



+ 1- 



M 
~K 



u{x). 
(94) 



As F^{x) = -F'(^2/x)FF«('^)' by the Marcenko-Pastur law 
(see Theorem 12 in Appendix F), we conclude that F^{x) 
converges a.s. to a limiting nonrandom distribution Fa (a;) with 
corresponding density 

■^^^^^ = ^^7(72 - - ^i)+ + [l-/3]+5{x). (95) 

From (94) we can, therefore, conclude that ^^//(i_|_a)-is(-^) 
converges a.s. to a nonrandom Umit given by 



F 



S«(I+A) 



Fa 



1 



1 



u{x). (96) 



Taking the derivative w.r.t. x on both sides of (96), the density 
corresponding to F^^h (jj^j^yi-^{x) is obtained as 



S^f(I+A)- 



= ^^^ll 



{1-x) 



^ + [l--]5{x). (97) 



We obtain the final result in (93) now by noting that /T(a;) = 
/s"^(i+A)"is(^) because of the unitarity of V and by insert- 
ing (95) into (97) and carrying out straightforward algebraic 
manipulations. ■ 
Based on Lemma 1, we can now apply Theorem 11 (Ap- 
pendix F) to conclude that F^^u^^^^Hj^ix) converges a.s. 
to a deterministic function F^ 



(1/M)HH»T'^ 

^(i/M)HH«T(a;) as M,K 



'*Note that (93) implies that fiix) is compactly supported in the inter- 
val [ti/(1 -t- 71), 72/(1 -1-72)1 . 
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oo with K/M — > (3. The corresponding limiting density 
/(i/m)hh"t(2^) is obtained through the application of the 
Stieltjes inversion formula (151) to the solution of the fixed- 
point equation 

fT{x)dx 



/CO 



l3-^zG{z)) 



zeC+ (98) 



in the set 

{G(z)GC|-(l-/3)/z + /3G(z)eC+}, zeC+ (99) 

where we used the symbol G{z) to denote the Stieltjes transform 
G(i/m)hh"t(-2^)- 111 the following, for brevity, we write G 
instead of G{z). To solve (98), we first compute the integral 
I on the RHS of (98). We substitute f^ix) from (93) into (98) 
and define 



m = 

to obtain 

7 = -i 

z 



71 



1 + 7i 



72 



+ 



_ V(l + 7i)(l + 72) 

1 + 72 ' ^ 27rd2 

P\J{r\2 -x){x- rii) dx 



1 r P_ 

^ Jrii x(l — 



(1 - X)2 (x (i^ - PG) - l) 



(100) 

The integral / is computed in Appendix G. Employing the 
notation introduced in Appendix G, we can finally write the 
fixed point equation (98) as 

1 1 + 



Gz 



X + A2I2 + Asis + AJ4 



(101) 



1 

so that (101) can be written as 

P-1 



■xMh 



2(3 



Gz + 



2/3 



(102) 



Next, multiplying (102) by 2d'^(3{Gl3z + z + /3- 1)^, squaring 
both sides, introducing the auxiliary variable 

G^-^^+PG 
z 

we obtain after straightforward, but tedious, manipulations that G 
must satisfy the following quartic equation 

G^ + aaG^ + a^G^ + aiG + ao 



with the coefficients 

03= -(2^-/3 + 1) 
z 



Oi 



22-/3+1 



rf2 



02 



ao 







Z-/3 + 3- 



(103) 



d2 



The quartic equation (103) can be solved analytically. The 
resulting expressions are, however, very lengthy, do not lead 
to interesting insights, and will therefore be omitted. It is im- 
portant to note, however, that (103) has two pairs of complex 



conjugate roots. The solutions of (103) will henceforth be de- 
noted as Gi,Gl,G2, and G2. We recall that our goal is to 
find the unique solution G of the fixed point equation (98) s.t. 
G = - (1 - -K/3G e C+ for all z G C+. Therefore, in each 
point z S C"*" we can immediately eliminate the two solutions 
(out of the four) that have a negative imaginary part. In practice, 
this can be done conveniently by constructing the functions G'l = 
5iGi+j|3Gi| andG!, = 3fiG2-|-j|9G2|, which can be computed 
analytically, satisfy (103), and are in C+ for any z e C+. Next, 
note that (102) has a unique solution in the set (99), which is also 
the unique solution of (98). We can obtain this solution G{z), 
z e C+, by substituting Gi = (l//3)(Gi - (/3 - l)/z) and 
G2 = (l//3)(G'2-(^-l)/z)into(102)and checking which of 
the two satisfies the equation. Unfortunately, it seems that this 
verification cannot be formaUzed in the sense of identifying 
the unique solution of (102) in analytic form. The primary 
reason for this is that to check algebraically if Gi and G2 
satisfy (102), we have to perform a noninvertible transformation 
(squaring) of (102), which doubles the number of solutions of this 
equation, and results in Gi and G2 both satisfying the resulting 
formula. The second reason is that depending on the values of the 
parameters (3 > 0,d > 0, the correct solution is either Gi or G2, 
and the dependence between Gi, G2, (3, and d has a comp heated 
structure. Starting from the analytical expressions for Gi and G2, 
we can identify, however, for any fixed /3 > 0, d > 0, the density 
function f(i/M)uu"T{x) = (I/tt) limy^o+ 3[G(a; + jy)] cor- 
responding to the unique solution of (102) [and hence of (98)] 
numerically. This is accomplished as follows. We know that, for 
given X, limj^^o+ 3 [G{x + jy)] is either equal to 



Li{x) 



lim 9[Gi(a; + jt/)] 

j/->0+ 



It is tedious, but straightforward, to show that for any /3 > or 



L2{x) ^ lim Q[G2{x + jy)]. 



Even though the functions and ^2(2;) can be computed 

analytically (with the resulting expressions being very lengthy 
and involved), it seems that for any fixed x > the correct 
choice between the values Li{x) and L2{x) can only be made 
numerically. The following algorithm constitutes one possibility 
to solve this problem. 



Algorithm — Choice of the Limit 
Input: a; > 

1) Choose a small enough y > Q 

2) Substitute G\{x + jy) and G2(a; -|- jy) 
into (102) 

3) IfGi{x + jy) satisfies (102), then 

return Li (x) 
otherwise 

return L2 (x) 



As any other numerical procedure, this algorithm includes 
a hevuistic element. The following comments are therefore in 
order. 

• In Step 1 of the algorithm, the choice of y cannot be 
formalized in the sense of giving an indication of how small 
it has to be as a function of /3 and d. On the one hand, y has to 
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be strictly greater than zero, because (102) in general holds 
in C"*" only and does not need to hold neither for Gi (x+jO) 
nor for G2{x + jO). On the other hand, y should be small 
enough for G'i(.T+j?;) to be close to Li(x) and G2{x+jy) 
to be close to L2{x). The correctness of the output of the 
algorithm is justified by the fact that G(2:) is analytic in C+ 
(see Definition 3 in Appendix F). 

• In Step 3 the check whether Gi{x + jy) satisfies (102) 
is performed numerically. Therefore, rounding errors will 
arise. It turns out, however, that in practice, unless | i^i (.r) — 
L2 {x) I is very small (in this case it does not matter which 
of the two values we choose), the solution of (102) yields 
a clear indication of whether Gi{x + jy) or G2 {x + jy) is 
the correct choice. 

• To compute the density f(i/M)uu"T{x) using the pro- 
posed algorithm, we need to run Steps 1-3 for every x. 
It will be proved below that /(i/m)hh«t(2;) is always 
compactly supported and bounds for its support will be 
given in analytic form (as a function of f3 and d). Since the 
algorithm consists of very basic arithmetic operations only, 
it is very fast and can easily be run on a dense grid inside 
the support region of f(i/M)HHHT{x). 

As an example, for d = 1 and f3 ~ 1/2, Fig. 5(a) shows the 
density /(i/M)HH"T(a;) obtained by the algorithm formulated 
above along with the histogram of the same density obtained 
through Monte-Carlo simulation. We can see that the two curves 
match very closely and that our method allows to obtain a much 
more refined picture of the limiting density. Fig. 5(b) shows the 
density /(i/m)hh«t(2;) for P = 2, 1, 1/2 obtained through 
our algorithm. We can see that the density function is always 
compactly supported. 

The final step in computing the asymptotic capacity of the AF 
relay network is to take the limit K, M ^ 00 with K/M ^ (3 
in (92) and to evaluate the resulting integral 



A 

•^AF — 



/3 



j + ^) /(i/M)HHffT(a;) dx (104) 



numerically. The evaluation of (104) is drastically simplified 
if we consider that /(i/M)HH"T(a;) is compactly supported. 
The corresponding interval boundaries (or, more specifically, 
bounds thereon) can be computed analytically as a function of /? 
and d. We start by noting that the second part of Theorem 12 in 
Appendix F implies that a.s. limM^oo '^max ((1/M)HH^) 

1 -|- v^)^- From (97) and Theorem 12, it follows that a.s. 
Amax(T) = d^{l+y/p)y{l3+d^{l+y/P)^).FoTanyK3lizanon 
of H and T and any M, K, by the submultiplicativity of the 
spectral norm, we have 

Amax((l/M)HH^T) < A„,ax((l/M)HH^) A„,ax(T) 

which implies that for M,K ^ 00 with K/M — > /3 a.s. 



Ama.((l/M)HH^T) < 



/3 + d2(l + V^)2 



We can thus conclude that /(i/m)hh«^t(2;) is compactly sup- 
ported on the interval'^ [0,a;max]- Consequently, the integral 

"The actual supporting interval of /(i/m)HH^^ T (^) ™^y> ^ smaller. 
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Fig. 5. Limiting density /(i/M)HH^fT(^) W for /3 = 1/2 and d = 1 along 
with its histogram (Monte-Carlo) and (b) for different values of /9 = 2, 1, 1/2 
and d=\. 



in (104) becomes 

Caf = 2 Jo ^ /(i/M)HHJ^T(a;) dx 

which we can compute numerically, using any standard method 
for numerical integration and employing the algorithm described 
above to evaluate /(i/m)hh«t(2^) at the required grid points. 
Using this procedure, we computed C^p as a function of /3 
for (i = 1 with the result depicted in Fig. 6. We can see that for 
/3 < 1 (i.e., K < M), C^p increases very quickly with j3, which 
is because the corresponding effective MIMO channel matrix 
builds up rank and hence spatial multiplexing gain. For (3 > 1 
(i.e., K > M), when the effective MIMO channel matrix is 
already full rank vwth high probability, the curve flattens out and 
for 13 oo, the capacity C^p seems to converge to a finite value. 
In the next subsection, we prove that C^p indeed converges 
to a finite limit as /3 — > oo. This result has an interesting 
interpretation as it allows to relate the AF relay network to a 
point-to-point MIMO channel. 



D. Convergence to Point-to-Point MIMO Channel 

In [1], it was shown that for finite Af, as if ^ oo, the two- 
hop AF relay network capacity converges to half the capacity 
of a point-to-point MIMO link; the factor 1/2 penalty comes 
from the fact that communication takes place over two time 
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Fig. 6. Capacity C^p as a function of /3 for <i = 1 and ir^ = 0.01. 



slots. In the following, we demonstrate that the result in [1] can 

be generalized to the M, K ^ oo case. More specifically, we 
show that for /3 ^ oo the asymptotic (M, K oo) capacity of 
the two-hop AF relay network is equal to half the asymptotic 
{Ad oo) capacity of a point-to-point MIMO channel with M 
transmit and M receive antennas. We start by dividing (103) by 
/3 and taking the limit^'' /? — > oo, which yields the quadratic 
equation 



z 1 



1 

d2 



G- 



1 



1 

d2 



0. 



(105) 



The two solutions of (105) are given by 

-z{l + ^) ± ^z^ (1+^)^-4.(1+^) 



2z 



(106) 



Applying the Stieltjes inversion formula (151) to (106) and 
choosing the solution that yields a positive density function, 
we obtain 

/3/(i/M)HHffT(a;) = - lim 9 [PG{x + jy)] 

IT y— >0+ 



= - lim 9 



G{x + jy) 



1 



4x 1 



1 



1 

rf2 



(107) 



Inserting (107) into (104) and changing the integration variable 



according to u = a;(l-|- we find that C^p 

where 



AF' 



47r 



--Hog 1 

u 



{cP + l)cr2 



u du. (108) 



Comparing (108) with [31, Eq. (13)], it follows that for /? ^ oo 
the asymptotic M,K ^ oo with K/M — > /? per source- 
destination terminal pair capacity in the two-hop AF relay 
network is equal to half the asymptotic (M oo) per-antenna 
capacity in a point-to-point MIMO link with M transmit and M 

^''it is important that first we take the limit M, — » oo with K/M — > /3 
and afterwards let /3 — » oo. 



receive antennas, provided the SNR in the relay case is defined 
as SNR = ((^2 + l)a2) . For M and large, it is easy to 
verify that this choice corresponds to the SNR at each destination 
terminal in the AF relay network. In this sense, we can conclude 
that for /3 ^ 00 the AF relay network "converges" to a point-to- 
point MIMO link with the same received SNR. 

VI. Conclusion 

The minimum rate of growth of the number of relays K, as a 
function of the number of source-destination terminal pairs M, 
for coherent fading interference relay networks to decouple was 
shown to be if oc under protocol PI and K oc Af^ under 
protocol P2. PI requires relay partitioning and the knowledge of 
one backward and one forward fading coefficient at each relay, 
whereas P2 does not need relay partitioning, but requires that 
each relay knows all its M backward and M forward fading 
coefficients. The protocols PI and P2 are thus found to trade off 
CSl at the relays for the required (for the network to decouple) 
rate of growth of if as a function of M. 

We found that cooperation at the relay level in groups of L 
relays, both for PI and P2, results in an L-fold reduction of the 
total number of relays needed to achieve a given per source- 
destination terminal pair capacity. An interesting open question 
in this context is whether more sophisticated signal processing 
at the relays (such as equalization for the backward link and 
precoding for the forward Unk) could lead to improved capacity 
scaling behavior. 

It was furthermore shown that the critical growth rates K oc 
in PI and if oc in P2 are sufficient to not only make 
the network decouple, but to also make the individual source- 
destination fading hnks converge to nonfading hnks. We say that 
the network "crystallizes" as it breaks up into a set of effectively 
isolated "wires in the air" . More pictorially, the decoupled links 
experience increasing distributed spatial (or more specifically 
relay) diversity. Consequently, in the large-M limit time diversity 
(achieved by coding over a sufficiently long time horizon) is 
not needed to achieve ergodic capacity. We furthermore charac- 
terized the "crystalUzation" rate (more precisely a guaranteed 
"crystallization" rate as we do not know whether our bounds 
are tight), i.e., the rate (as a function of M, K) at which the 
decoupled links converge to nonfading Unks. In the course of 
our analysis, we developed a new technique for characterizing the 
large-deviations behavior of certain sums of dependent random 
variables. 

For noncoherent fading interference relay networks with 
amphfy-and-forward relaying and joint decoding at the cooper- 
ating destination terminals, we computed the asymptotic (in M 
and K with K/M ^ (3 fixed) network capacity using tools 
from large random-matrix theory. To the best of our knowledge, 
this is the first application of large random-matrix theory to 
characterize the capacity behavior of large fading networks. 
An elegant extension of this approach to the case of multiple 
layers of relays was recently reported in [32]. We furthermore 
demonstrated that for /? ^ oo the relay network converges to a 
point-to-point MIMO hnk. This generalizes the finite-M result 
in [1] and shows that the use of relays as active scatterers can 
recover spatial multiplexing gain in poor scattering environments. 
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even if the number of transmit and receive antermas grows large. 
More importantly, our result shows that linear increase in the 
number of relays as a function of transmit-receive antennas is 
sufficient for this to happen. 

The large-deviations analysis, along with the notion of decou- 
pling of the network, as carried out in this paper could serve 
as a general tool to assess the impact of protocols, processing 
at the relays, propagation conditions, routing, and scheduling 
on network outage and ergodic capacity performance. More 
specifically, an interesting question is under which conditions 
"crystaUization" can happen in a general network and, if it occurs, 
what the corresponding "crystallization" rate would be. It has to 
be noted, however, that, in view of the technical difficulties posed 
by the basic case analyzed in this paper, it is unclear whether 
this framework can yield substantial analytical insights into the 
above-mentioned questions. 

Finally, we note that if we interpret our results in terms of per- 
node throughput, we find that PI achieves 0{l/ri?/^) whereas 
P2 realizes 0(1/ \/n). The scaling law for P2 is exactly the same 
as the behavior established by Gupta and Kumar in [6] and the 
per-node throughput goes to zero. On the other hand, it is interest- 
ing to observe that we can get an 0(1/ ^/n) throughput without 
imposing any assumptions on the path-loss behavior. General 
conclusions on the impact of fading on the network-capacity 
scaling law cannot be drawn as we are considering a specific 
setup and specific protocols. It was recently shown [33], however, 
that under optimistic assumptions on CSI in the network 0(1) 
throughput can be achieved using hierarchical cooperation. 
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Appendix A 

Truncation of Random Variables and Large 
Deviations 

We start by recalling the famous Hoeffding inequality along 
with an important variation that will be central for our develop- 
ments. 

Theorem 8 (Hoeffding [34]): Let Xi, X2, . . . , be inde- 
pendent real- valued RVs and A„ < X„ < B„ for n e [1 : A'^]. 

N 



Let Sn = J2n=i ^ri- Then, 



Pj^iv - EfS'Ar] > Nx} < exp -- 



2N^x 



2^2 



Etl(s„-^„)^ 



Theorem 9 (Maurer [35]): Let Xi,X2, . . . , Xn be indepen- 
dent real- valued RVs with X„. > and E [X^] < 00 for 



ne [l:iV].Let5Ar = 
¥{Sn - MSn] < 



En=i ^n- Then, 
—Nx} < exp 



The following theorem builds on the Hoeffding inequaUty 
(Theorem 8) and constitutes the core of the truncation technique. 
Theorem 10: Assume on a common probability space: 

• The real-valued RVs Xi,X2, ■ ■ ■ ,Xn (possibly dependent) 
have marginal distribution functions Fx,, ('c), n G [1 : A^]. 
The tails of these distributions are exponentially decaying 
uniformly in n, i.e., there exist B > 0, a> 0, /3 > 0, and 
a;o > s.t. for X > > and n e [1 : AT] 

P{|^n| > a;} = 1 - Fx„(a;) + Fx„(-a;) < Be-""^ 

(109) 

• The real-valued RVs ^1, 02, ■ • • , 0Ar are jointly indepen- 
dent and satisfy 

-l<<^n<l, E[0„]=O, ne[l:N]. 

• The real-valued deterministic nonnegative coefficients 
Ai, A2, ■ ■ ■ , Ajsf are uniformly bounded from above, i.e., 
there exists a constant A independent of n s.t. 

< A„ < A, 



The set of RVs 



N 



{(f>n}n=V 

Let Sn = E^i=i AnXn(j)n- Then, for all A' > and a; > 



n e [1:A]. 
^ is independent of the set 



s.t. X > X, 



(2+/3)/2 




< 2max;[2,AB]exp( 







2fi \ 


^— min 




1 



(110) 



Proof: The proof is based on the idea of truncation of the 
RVs A„. We start by fixing N and choosing t s.t. [Nt'^y > xq. 
The truncation parameter < 7 < 1 will be chosen later. Next, 
we truncate the RVs A„, n e [1 : A], according to 

A„/[|A„| < {my . 

Define Sn — J2n=i^nXn<l>n- Note that the independence of 
{^n}n=i and {<l)n}„=i and the condition E [(/>„] = (n G [1 : 
N] ) implies that E [Sjv] = E [^jv] = 0. Let 7„ denote the event 
that Xn is equal to its truncated version, i.e., /„ = {X„ = A„} 
and, /„ the event that A„ ^ A„, i.e., /„ = {A„ ^ A„}. With 
these definitions, distinguishing the events where either all X„ 
are equal to their truncated version, i.e., C\n=i and where at 
least one of the A„ is not equal to its truncated version, i.e., 
Un=i ^n, we get 
¥{\Sn\ > Nt] 

= n\SN\>Nt f|j„ 



> Nt 
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Sn\ > Nt 



N 



N 



n=l 



<^{\Sn\> Nt} + ^¥{ln} 



where the last step follows by using the trivial bounds 



(111) 



N 



< 1, 



\Sn\ > Nt 



N 



n—1 > 



< 1 



and applying the union bound to P{U!^=i ^n}- Since —1 < 
4>n < S [1 : A'^J, we obtain the following bounds for the 
individual terms in ^jv 

-An{Nty < AnXnCpn < A^Nt^Y , n € [1:7V]. 

Moreover, owing to the independence of the 4>n, conditioned 
on the set X = X2, . . . , ^w}, the RVs AnXn4'n are 

independent. Therefore, using Bayes' rule and the Hoeffding 
inequality (Theorem 8), noting that E [Sn | A"] =0, we can 
conclude that 



P S, 



N 



> iVf} =Ea'[p{|s'jv 
< 2exp 



E 



Sn 



X 



> Nt 



< 2 exp 



2A^ J ■ 



(112) 



Next, using (109), and assuming [this will be justified in (114)] 
that {Nt^y > xa, we have 



= P{|^n| > {Nt^y^ < Be 



2\T/3 



(113) 



To get the fastest possible exponential decay in (1 1 1), we need to 
choose the free parameter 7 s.t. it maximizes min[l — 27. 7/?], 
which is the solution that makes the exponents of t in (112) 
and (113) equal and is given by 7 = 1/(2 + Finally, 
setting t = x/^/N results in 

{my = x^^ = x^/^^+f^^ > xo (114) 
as required. Combining (111), (112) and (113), we finally obtain 

P{|5'jv| > y/Nx} 

<2exp^-^^x^^ + NBexp(^-ax^^ . (115) 

The final result (110) is a trivial upper bound to (1 15). ■ 
The following corollary is the generalization of Theorem 10 

to the complex-valued case and will be used repeatedly in the 

proofs of Theorems 1 and 2. 

Corollary 1: Assume on a common probability space: 
• The absolute values of the complex-valued (possibly de- 
pendent) RVs X\,X2, ■ ■ ■ , Xn have marginal distribution 



functions Fx^x), n e [I'-N]. The tails of these distribu- 
tions are exponentially decaying uniformly in n, i.e., there 
exist B>0, a>0, P>0 and xq > s.t. for a; > > 
and n e [1 : A''] 



P{|^n| > a;} = 1 - Fx„{x) < He- 



ine) 



The real- valued RVs ^i, • • • , (t>N are jointly indepen- 
dent and satisfy (j)n U (—• tt, tt) and hence E [e-'''^"] = 
for all n G [1:^^]. 

The real-valued deterministic normegative coefficients 
Ai, A2, ■ ■ ■ , Ai\j are uniformly bounded from above, i.e., 
there exists a constant A independent of n s.t. 



0<An<A, 



n e [l:N]. 



• The set of RVs {Xrt}^=i is independent of the set 

{(t>n}n=l- 

Let Sn = En=i ^n^ne-''^''. Then, for all TV > and a; > 



s.t. X > X, 







< 4max[2, A^B]cxp 



2^2^ 



Proof: Apply Theorem 10 to ^Sm and SS'jv separately and 
combine the two bounds using the Pythagorean union bound 
(Lemma 3). ■ 

The following corollary is a modification of Theorem 10 
for the case of independent nonnegative RVs and will be used 
repeatedly in the proofs of Theorems 1 and 2. 

Corollary 2: Assume on a common probability space: 

• The real- valued nonnegative RVs Xi,X2,. ■ ■ ,Xm are 
jointly independent and have marginal distribution func- 
tions Fx„{x), n E [1 : A^]. The right tails of these 
distributions are exponentially decaying uniformly in n, 
i.e., there exist B>0, a>0, p>0 and xq > s.t. for 
all a; > a;o > and n e [1 : AT] 

¥{Xn >x} = l-FxAx)< Be-" . (117) 

• The expectations E[X2] are uniformly bounded from 
above, i.e., there exists a constant C independent of n s.t. 



E[Xl]<C, ne[l:N]. 



(118) 



The real-valued deterministic normegative coefficients 
^1, A2, . . . , Ajv are uniformly bounded from above, i.e., 
there exists a constant A independent of n s.t. 



0<An<A, n€[l:N]. 



(119) 



Let Sn = En=i ^nXn- Then, for all A' > and a; > s.t. 



X > X, 



(2+/3)/2 




"{iSjv-EfSjv]] > VNx} 
< 3 max[l , NB] exp ( — min 



2f) 



. (120) 



Proof: The proof idea of this corollary is similar to that 
used in Theorem 10. However, there are several technical details, 
which do not occvff in the proof of Theorem 10. We have. 
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therefore, decided to present the full version of the proof of 
Corollary 2. 

Unhke in the proof of Theorem 10, here we have E [Sn] ^ 0. 
To obtain an upper bound on P| |5jv — E[S'jv] | > yfNx^, we 
establish an upper bound on Pj^Ar > £[5* at] + \/ N:r^ and on 
P{'S'Ar < E[S'jv] — \fNx\ and use the union bound to combine 
the results. 

We start by deriving an upper bound on PjS'Ar > E [Sjv] + 
V iVx} . Following the same steps as in the proof of Theorem 10, 
we define the truncation parameter < 7 < 1, which will be 
chosen later Fix N and choose t s.t. (^Nt^)"' > xq. We truncate 
the RVs Xn (n e [1 : A^]) according to 



Xn < {my 



and define Sn = J2n=i ^n^n- It is easily seen that E [Sn] > 
E [Sn] and therefore 



5'Ar > E 



S 



N 



Nt 



}• (121) 



Let /„ denote the event that Xn is equal to its truncated version, 
i.e.. In = {Xn = Xn}, and /„ the event that Xn 7^ Xn, i.e.. 
In — {Xn 7^ -^ri}- With thcsc definitions, distinguishing the 
events where either all Xn are equal to their truncated version, 
i.e., C\n=i and where at least one of the Xn is not equal to 
its truncated version, i.e., U^=i ^n, we get 




< P-^ 5'^r > E 



(122) 



where the last step is obtained by using the trivial bounds 



N 



< 1, 



Sat > E 



^n=l 



5JV 



+ Nt 



N 



n— 1 y 



< 1 



and applying the union bound to P{1J^^^ /„}. The individual 
terms in S'a? are bounded according to 

< AnXn < An{Nfy , nG[l:N]. 

Using Bayes' rule and the Hoeffding inequality (Theorem 8), 
we can conclude that 



Sat >E 



S 



N 



exp 



< exp I — 



2(ivt2)i-2n 



A2 



(123) 



Next, using (117), and assuming [this wUl be justified in (125)] 
that [Nt'^y > xo, we have 



»{/„}= p{x„^x„} 



(124) 



To get the fastest possible exponential decay in (122), we need to 
choose the free parameter 7 s.t. it maximizes min [l — 27, 7/3] , 
which is the solution that makes the exponents of t in (123) 
and (124) equal and is given by 7 = l/(2 + /3). Finally, setting 
t = x/VN results in 

r2/(2+/3) 



,2\7 



{m^) 



.27 



(125) 



as required. Combining (121)-(124), we obtain 

pj^AT > E[Sn] + VNx} 

( 2 I 2g \ 

< expl --^a;2+/3 1 + iVBexp(^-aa;2+/3 j . (126) 



It remains to establish an upper bound onPjS'Ar < E[S'Ar] 
Nx}. From Theorem 9 it follows that 



iVx2 



which, using (118) and (119), can be further upper-bounded as 

¥{SN<nSN]-^/Nx}<e^p(^-^^y (127) 

Combining (126) and (127) and using the union bound, we 
obtain 



2/3 
;2 + /3 



P{|5jv -E[5jv]| > VNx} < exp(^--^x5 

+ NB exp (-a x^) + exp (- j . (128) 
The final result (120) is a trivial upper bound to (128). 



Appendix B 
Union Bounds 

In this appendix, as a reference, we present several variations 
of union bounds for probability that we use frequenfly throughout 
the paper. 

Lemma 2 (Union bound for sums): Assmne the complex- 
valued RVs Xi,X2, . . ■ , Xn are s.t. 

^{\Xn\>Cn}<Pn, n€[l:N] 

where Ci, C2, . . . , Cn and Pi, P2, • • • , Pn are fixed positive 
constants. Then, 



N 



N 



N 



Proof: Let A„ denote the event that |X„| > Cm n G 
[l:N]. Let B denote the event that \ YZ=i Xn\ > J2n=i ^n- 
By inspection, it follows that B (J^^^ An, which implies 

P{5}<EtlP{^n}. ■ 
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The proofs of the remaining union bounds follow exactly the 
same pattern as the proof of Lemma 2 and will hence be omitted. 

Lemma 3 (Pythagorean union bound): Assume the complex- 
valued RV X is s.t. 

P{|5?X| > Cr} < Pr and p{|S>X| > Ci} < Pi 
where Cr, Ci, Pr, and Pi are fixed positive constants. Then, 

P{|^| > V^CgTcf} <Pr + Pi. 

Lemma 4 (Union bound for mixed sums): Assume that the 
complex- valued RVs Xi, X2, . . . , Xjv are s.t. 

P{|^„| >C„} <P„, ne[l:iV] 

where Ci, C2, . . . , Cn and Pi, P2, . . . , Pjv are fixed positive 
constants; then, the following statements hold: 

1) If the real- valued RVs X( , , . . . , X^, are s.t. 

P{x; < C;} < P;;, ne[l:7V] 

where CJ, C2, . . . , C^ and Pi, P2, • • • , Pjv are fixed pos- 
itive constants, then 



TV 



N' 



n=l 



< max 



N' 



N 



N 



N' 



2) If the real- valued RVs X( , , . . . , X^, are s.t. 

p{x;>c;}<p;, ne[i:iv] 

then, 



N 



N' 



E^" + E^n 



n=l 



AT' 



AT 



^E^» + E^" 



n=l 



<E^" + E^n- 



Tl=l 



n=l 



Lemma 5 (Union bound for products): Assume the complex- 
valued RVs Xi , X2 , . . . , Xat are such that 

^{\Xn\>Cn}<Pn, n^[l:N] 

where Ci, C2, . . . , Cjv and Pi, P2, . . . , Pa^ are fixed positive 
constants. Then, 



AT 



n=l 



N 



N 



Lemma 6 (Union bound for fractions): If for real- valued 
positive RVs Xi and X2 and positive constants Ci , C2 and 

Pl,P2 



then 



"{^1 > Ci} < Pi and pjXa < C2} < P2 
p{Xi/X2 > C1/C2} < Pi + P2. 



If, in turn. 



then 



'{Xi < Ci} < Pi and p{x2 > C2} < P2 
p{Xi/X2 < C1/C2} < Pi + P2. 



Appendix C 
Proof of Theorem 1 

We start by recalling that we want to establish a concentration 
result for SINRJ^,^, given by (22), using the truncation technique 
throughout. As already mentioned, this entails establishing the 
large-deviations behavior of S'^^\ S^'^\ S^'^\ and S'(^). For S^^\ 
this has aheady been done in Section ni-C2. It remains to 
estabhsh the corresponding (based on the truncation technique) 
concentration results for S^''\ S^'^\ and S'(^) defined by (23), 
(24), and (26), respectively. 



A. Analysis of S'^^^ 

The sum S^^^ can be written as 



with 



k:p{k)—m 



Zj^^ — l/m,fe| \hk,; 



(1) 



(129) 



For any k e [^-K] s.t. p{k) = m, we haveE[Z^^^] = 7r/4and 
E[(Z^^y] = 1. Application of the union boimd for products 
yields 



i4'' > 



< 2e" 



a; > 0. 



Noting that the sum S^^^ contains K/M terms, which are jointly 
independent, taking into account (12), and using Corollary 2, we 
get for a; > and K/M > 1 



k:p{k)=m 



> < 4^-^'^'^^'^ 

- V M I - M 



with A(i) = min[l, 1/(2 C^)] . Finally, using (12), it follows 
that 



4: M y M 



M 



(130) 



and 



A S^'^ < - \/ S 4 < 4-"^'"^^'^ (131) 

I ~ 4 — M V M I ~ M 



for any a; > and K/M > 1. 
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_a(1)„2/3 KiM—1) _a(2) 2/3 _.(31) 2/5 

^ (i^-l)j^(M-l)^ ^_^(3.)^2/. ^ (i^-l)j^jM-l) ^_^(3.)^2/; 



M 



322 + aiife =^4 



I Ctt V K Ctt 



IJpi = max 



0, 



M-l 



K 

1 A/ - 1 



X2 



(137) 
(138) 



M 



■1'31 



(if-l)(Af-l)2 



■ 2:321 



1 {K-l){M-l) 



(-,2 



2:322 



^2 



max 



X4 



^2 



(139) 



fi. Analysis of S'^'^'^ 

The sum S'^^^ can be written as 



with 



^(2)^ E c-i-zf^ 

7(2) A f * f , h* h. 

~ Jp{k),k Jm,k "■k,p{k) "'k,m- 



For any fee [I : K] s.t. 7^ m, we have E[Z^^] = 0. 
Application of the union bound for products yields 

P{ > a;} < 26""^, a; > 0. 

Noting that the sum 5*^^' contains K{M — 1)/M terms, which 
are jointly independent, taking into account (12), and using 
Corollary 1, we get for a; > and K{M - 1)/M > 1 



^(2 



M 



M 



with A(2) = 2-smin[l,l/(2C^)]. 

C. Analysis of S'^'^^ 
The sum 

5(4) 

can be written as 

s^'^ = f:{CT,,k)"zi" 



(132) 



fc=i 



with 



Since zj^^ is exponentially distributed with parameter A = 1, 
we have 



A; e [1:K], x>0. 



Noting that the sum 5^*^ contains K jointly independent 
terms, taking into account (13) and using 

E[4'''] = 1 and 
E[(Z^'*y] =2{kG [l:Js:]), wegetfora:>Oandif > 1 



K 



fe=i 



with a'**) = min [l, 1/ (4 c^)] . Therefore, using (13), it follows 
that 



and 



< Kc^ - VKx^ < 3Ke- 



,^(4)^2/3 



(133) 



(134) 



We are now ready to carry out the final Step v of the program 
outhned in the first paragraph of Section III-C. The concentration 
result for SINRJ^^ is expressed in terms of upper bounds on 
P{SINR" > Upl} andPjSINRj^,^ < Lpi}, where the exact 
form of C/pi and Lpi is specified below. 

To establish an upper bound on P{SINR^^ > Upi}, we 
proceed as follows: 

1) Apply Part 2 of Lemma 4 to (130) and (132) to establish 
a stochastic upper bound^' for | S^^^ + S^'^^ | . 

2) Apply Part 1 of Lemma 4 to (45), (52), and (53) to establish 
a stochastic lower bound^^ for [S^^^ |. 

3) Apply Part 1 of Lemma 4 to the result from Step 2) 
and (134) to establish a stochastic lower bound for 
5(3) + (^2^^(4) ^ xMa\ 

4) Apply the union bound for fractions (Lemma 6) to the 
stochastic upper bound from Step 1 and to the stochastic 
lower bound from Step 3 to establish the final result: 



»{sINRPi > 



Upi} 



with 



C K 



PI 



^ -'pi 



77N 



(135) 



(136) 



and Ppj, JJp^ and tjp^ defined at the top of the page in 

(137), (138) and (139), respectively. 
An upper bound on P{SINRPi < Lpi} can be obtained as 
follows: 

1) Apply Part 1 of Lemma4 to (131) and (132) to establish 
a stochastic lower bound for jS*'^^ + 5'^^^ |. 

2) Apply Part 2 of Lemma 4 to (44), (52), and (53) to establish 
a stochastic upper bound for \S^^\ 

^'Fot a RV X, a "stochastic upper bound" in this context means a bound of 
the form P{X >A}<P. 

^^For a RV X, a "stochastic lower bound" in this context means a bound of 
the form P{X < A} < P. 
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Lpi = max 





[m 








cJ 



M{M - 1) 



K 



D ^ C M-1 1 M-1 



7- U ^ 

-^Pl - =2 



F — 

m, — 



Var[W„ 



SN 



I? 

Q 



M 



MvK r 



1 /(i^-l)(M-l)2 



2:321 



1 \{K-\){M-\) 



SN 



X322 + =2~ C + 



a 



SN 



0:4 



Pl,q 



g:p(q) 



2 I t^/A\r'2 



q:p(q)=m 
1i 



(142) 



— (143) 

<^SN 

(146) 
(147) 



-2 



QM 



m^m q:p{q)=m 
r2 



+ 0^2. E l^Pi,,j + Q ^ E (^PiJ E (^PiJ (148) 

rh^m i-vMitm q:p{q)=m q:p{q)^m 

p(q)^rh 



3) Apply Part 2 of Lemma 4 to the result from Step 2 and 
to (133) to establish a stochastic upper bound for S^^^ + 

4) Apply the union bound for fractions to the stochastic lower 
bound from Step 1 and to the stochastic upper bound from 
Step 3 to estabhsh the final result: 



"{sINRPI <ipi} <pu (140) 



with 



Lpi 



^SN PI 



(141) 



and Lp^ and Lp^ defined at the top of the page in (142) 

and (143), respectively. 
The result presented in Theorem 1 is a simpler and slightly 
weaker form of the bounds (135) and (140). To obtain this 
simplification we proceed as follows. Set xi ^ X2 = x^i = 
Xi = .'/;32i = .^322 = X in (137), (138), (139), (142) and (143). 
Note that in this case Lpi{x) < Lpi{x) and Upi{x) > Upi{x) 
and therefore 



p{sINRPi > C/pi} < p{sINRP^ >Upi}< Ppi (144) 
p{sINRPi < Lpi} < p{sINRPi < Lpi} < P^- (145) 
Finally, combine the bounds (144) and (145) according to 

p{(SINRP1 > Up,) U (SINR^i < Lpi)} 
< pjsiNR^i > ?7pi} + pjsiNR^i < ipi} < 2P^i 
and note that 2P^^ is upper bounded by the RHS of (56). ■ 

Appendix D 
Proof of Lower Bound in Theorem 6 

As already mentioned in the main body of the paper, the proof 
of the lower bound in (89) is based on the technique summarized 



in Appendix E. After straightforward algebra, it follows that the 
I-O relation of the SISO charmel between the terminals .S^ and 
©TO {m G [1:M]) is given by 



where 



Q 



F = 
and 



1 



q 



9=1 



J2 

rh^m 



Q 



1 



* g=l 



1 

7q 



Q 



9=1 



m,rh A r^,m ffH f \ ff.H . N 

"9 ~ Pl,q \ p(Q),g "^'1 J \ qMi) 1'"^ J 

°q — "-^Pl.g \^p{q),q^i-n,q J 
^Pl,™ ~ dpi,qPm,qEq^m 
\/Qdpi 

,qPm,q' 



/^m A 
^Pl,9 



It is not difficult, but tedious, to verify that F^. Var [F^] and 
Var[VFm] are given by (146), (147) and (148), respectively. 
Using (3), we lower-bound and upper-bound Var [F^] and 
Var [Wro] , substitute the resulting bounds into (150), and obtain 



I{ym;Sra)>\l0g(l+^^^l{M,L) 



(149) 



where 
f{M,L) 



(f + + a^) (e(M, L) + + a^c^ + a^) 
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with 



+ 



(l + (7r/4)(L-l)) (2C' + a2c2) 



M 



Finally, since L is finite, it follows by inspection that 
liniM^oo -£/) = and, therefore, 

7-2/^2 

lim /(Af,i) 



M— >oo — 



c 



SN 



which, together with (149), concludes the proof. ■ 

Appendix E 

Lower Bound on Channel Capacity with Imperfect 
Channel Knowledge 

The following Lemma is obtained by recognizing that the 
expression in [23, Eq. (66)] is trivially a lower bound to I{X\ Y) 
in (150) below. For completeness, we present the result in the 
form needed in this paper. For the proof of the (general) statement 
the interested reader is referred to [23]. 

Lemma 7: Consider a SISO channel with I-O relation 

Y = FX + W 

where X CA/'(0, cr\), W is zero-mean noise-^^ with variance 
(7^, F is the random channel gain with variance o"|., and Y is 
the output of the channel. Assume that F can be decomposed as 

F = F + F 

where F = E [f ] is known at the receiver and F with ¥.[F\ =0 
is not known at the receiver. Assume that X is statistically 
independent^"* of both F and W . Then, the mutual informa- 
tion I{X;Y) can be lower-bounded as follows 



7(X;F)>log 1 + 



1 9 



a 



w 



(150) 



Appendix F 

Some Essentials from Large Random-Matrix 
Theory 

In this section, we briefly summarize the basic definitions and 
results from large random-matrix theory used in this paper. An 
excellent tutorial on this subject is [25]. 

Definition 3 (Stieltjes transform): Let F{x) be a distribution 
function with density f{x). The analytic function 



Gf{z) 



dx. 



G C+ 



is called the Stieltjes transform of F{x). 

Lemma 8 (Inversion formula): Let Gp{z) be the Stieltjes 
transform of a distribution function F(x). The corresponding 
density function can be obtained as 

f{x)=^ lim '^[Gpix + jy)]. (151) 

^^In contrast to [22, Section HI], the noise is not necessarily Gaussian. 

^In [22, Section HI], it is assumed that X, F, and W are statistically 
independent. The condition required here is weaker: F and W need not be 
statistically independent. 



Theorem 11 (Silverstein [24]): Define the following quanti- 
ties on a common probability space: 

• The random matrix X S C^^^ has i.i.d. zero-mean 
entries with variance one. 

• The random matrix Y G C^^^ is Hermitian nonnegative 
definite with F-^{x), for N ^ oo, converging on [0, oo) 
a.s. to a nonrandom distribution function Fy(x) with cor- 
responding density ,fY{x). 

Assume that the matrices X and Y are statistically independent. 
Then, for N,N' ^oo with N/N' /?, 



F 



N 

(l/Af')XX"Y 



hy(^) 



with its Stieltjes transform Gf^^^^,^^^h^{z) satisfying 
f-^{x)dx 



/ 

J — ( 



eC+. 



The solution of this fixed-point equation is unique in the set 



\Gf , „ (z) € C 

|_ -^(l/N'jXX-ffY ^ ' 

1 



(l/W)XX^Y 



We shall furthermore use the Marcenko-Pastur law as stated 
in [36]. 

Theorem 12 (Marcenko-Pastur [37]): Assume that the ma- 
trix X G C^^^ has i.i.d. zero-mean entries with variance d^. 
Then, for TV, TV' oo with N'/N 6, the ESD of 
(1/7V')XX^ converges a.s. to a limiting distribution function 
with density 

/(i/iv')xx«(a^) = ^^V(72-a;)+(a:-7i) + 

+ [1-P]+S{x) 

where 71 = ^^(i _ 1/^^)2 and 72 = ^^(l + 

Under the same assvunptions as in the first statement, if, in 
addition, the entries of X have finite fourth moments, then a.s. 

1 

71 



lim Amin T77XX 

lim Amax(-^XX 

JV'— >C!0 V TV 



H 



H 



72- 



Appendix G 
Computation of the Integral J in (100) 

In the foUowing, we detail the computation of the integral 



rv2 



^{r]2 - x){x - T]i)dx 
'VI x(l - x)2 (a; - /3g) - 1) 

on the RHS of (100). With the change of variables 
t = 

and the notation 



7J2-X 



/xi = 1 - ?yi i/i = r]i{ "^-^ - l3Gj - 1 
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= 1 



??2 



J^2 = ??2 ( - — - - I3G 



the integral / can be written as 

^_ _ 2 r t'it^ + '^)dt 

To simplify further, we introduce the notation 

A Vl A /"I A Z^l A 2(j?2-??l)^ 

Kl = , K2 = , K3 = , X= o 

??2 M2 t/2 



m /«2 ^2 



SO that 



i=.r (152) 



Upon partial fraction expansion of the integrand in (152), 
obtain 



we 



/ = x{Mh + A2I2 + Ajs + Aji) 



where 



/o 



/3 



dt 

°° dt 



■f 

Jo 



dt 

dt 



Jo 



t2- 



K2 



Jo t"^ - «3 



with 



Ki{ki + 1) 



^ ^ K2(/t2 + 1) 

(k2 - '«i)(k2 - '^a) 

^ — k| — K1K2 + + 2K1K2K3 — K2'*3 

^ (k2 - ki)^(k2 - Ka)^ 

^ ^ /t3(K3 + 1) 

{ks - Ki){ks - 

The integrals in (153) can be evaluated resulting in 



h = 

12 = 

h = 



I axctan ■ 



t 



y/-Kl 

t 

^2K2{f - K2) 
AK2^/-K2 



2^/=M 

1 t 

arctan 

V-K2 



Q 2k2v'-«2 



1 



arctan 



i/^K2 V-'«2 

y 1 i 

I4, = arctan 



2y=^«2 



2^/=Ki" 



(153) 

(154) 
(155) 
(156) 
(157) 

(158) 

00 



(159) 
(160) 
(161) 



The quantity kz is complex- valued, and the arctan and square 
root in (160) are understood as the principal values of these 
functions in C as defined in [38]. 

Finally, by inspection, combining (158)-(161) with (154)- 
(157) and resubstituting the values of the parameters k\, K2, 



K3, X' Mi> M2, ^72, J^i, J^2, 71, and 72, after straightforward 
but tedious simplifications, we find 



xAih = 

xMh = 

X^3^3 = - 



2(3 



zd^ - 1) {G(3z + Z + P-1) 
2d2/3(G/3z + z + /?-l)2 



+ 



2d'^P{G/3z + z + l3-lf 
{GPz + (3~l) 
' 2d'^(3{GI3z + z + (3 - ly 



d^{G(3z + z + p~l){^/p-l)^ + zl3 
^^ d^{G(3z + z + p - 1) {y/p + if + zf3 

X (d\G(3z +Z+P-1) +iy +zpy 
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